-- Logs begin at Tue 2021-06-01 09:14:19 UTC, end at Tue 2021-06-01 10:25:58 UTC. --
Jun 01 09:57:53.901151 dv-cinder-787262-4-iscsi systemd[1]: Started Devstack devstack@q-svc.service.
Jun 01 09:57:54.860132 dv-cinder-787262-4-iscsi neutron-server[92456]: Beware of the coming changes in the project packaging
Jun 01 09:57:54.860758 dv-cinder-787262-4-iscsi neutron-server[92456]: https://github.com/svinota/pyroute2/discussions/786
Jun 01 09:57:56.316151 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.common.config [-] Logging enabled!
Jun 01 09:57:56.316834 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev249
Jun 01 09:57:56.316937 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=92456) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
Jun 01 09:57:56.320643 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.common.config [-] Logging enabled!
Jun 01 09:57:56.320898 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev249
Jun 01 09:57:56.321203 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=92456) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
Jun 01 09:57:56.322117 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 01 09:57:56.322349 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 01 09:57:56.322701 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 01 09:57:56.322960 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 01 09:57:56.323185 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 01 09:57:56.323501 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] allow_bulk                     = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.323795 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] allow_overlapping_ips          = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.324087 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] api_extensions_path            =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.324313 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] api_paste_config               = api-paste.ini {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.324605 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] api_workers                    = 2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.324888 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] auth_strategy                  = keystone {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.325161 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] backlog                        = 4096 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.325446 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.325739 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] bind_host                      = 0.0.0.0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.326020 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] bind_port                      = 9696 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.326294 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] client_socket_timeout          = 900 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.326578 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] config_dir                     = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.326803 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.327107 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] config_source                  = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.327391 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] control_exchange               = neutron {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.327675 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] core_plugin                    = ml2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.327897 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] debug                          = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.328175 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] default_availability_zones     = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.328595 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.329010 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] dhcp_agent_notification        = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.329288 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] dhcp_lease_duration            = 86400 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.329573 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] dns_domain                     = openstacklocal {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.329850 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] enable_traditional_dhcp        = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.330116 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] external_dns_driver            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.330390 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] filter_validation              = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.330668 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] global_physnet_mtu             = 1500 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.331014 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] host                           = dv-cinder-787262-4-iscsi {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.331288 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] http_retries                   = 3 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.331571 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] instance_format                = [instance: %(uuid)s]  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.331851 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.332131 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ipam_driver                    = internal {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.332402 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ipv6_pd_enabled                = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.332674 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] log_config_append              = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.332952 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.333787 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] log_dir                        = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.334060 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] log_file                       = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.334339 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] log_rotate_interval            = 1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.334635 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] log_rotate_interval_type       = days {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.334930 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] log_rotation_type              = none {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.335214 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.335435 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.335653 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.335938 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.336220 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.336492 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] max_dns_nameservers            = 5 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.336759 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] max_header_line                = 16384 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.337025 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] max_logfile_count              = 30 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.337305 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] max_logfile_size_mb            = 200 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.337556 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] max_subnet_host_routes         = 20 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.337822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] network_link_prefix            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.338101 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.338382 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.338662 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] pagination_max_limit           = -1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.338958 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] periodic_fuzzy_delay           = 5 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.339231 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] periodic_interval              = 40 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.339511 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] publish_errors                 = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.339763 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] rate_limit_burst               = 0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.340038 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] rate_limit_except_level        = CRITICAL {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.340304 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] rate_limit_interval            = 0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.340569 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] retry_until_window             = 30 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.340834 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] rpc_response_max_timeout       = 600 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.341114 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] rpc_state_report_workers       = 0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.341376 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] rpc_workers                    = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.341641 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] send_events_interval           = 2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.341935 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.342214 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] setproctitle                   = on {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.342489 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] state_path                     = /opt/stack/data/neutron {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.342767 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] syslog_log_facility            = LOG_USER {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.343083 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] tcp_keepidle                   = 600 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.343363 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] transport_url                  = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.343630 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] use_eventlog                   = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.343899 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] use_journal                    = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.344166 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] use_json                       = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.344434 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] use_ssl                        = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.344697 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] use_stderr                     = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.344973 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] use_syslog                     = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.345240 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] vlan_transparent               = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.345507 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] watch_log_file                 = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.345772 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] wsgi_default_pool_size         = 100 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.346039 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] wsgi_keep_alive                = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.346319 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:56.346612 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.346920 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.347218 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] profiler.connection_string     = messaging:// {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.347497 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] profiler.enabled               = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.347788 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] profiler.es_doc_type           = notification {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.348064 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] profiler.es_scroll_size        = 10000 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.348349 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] profiler.es_scroll_time        = 2m {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.348623 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] profiler.filter_error_trace    = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.348932 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] profiler.hmac_keys             = SECRET_KEY {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.349222 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.349505 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] profiler.socket_timeout        = 0.1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.349779 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy      = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.350064 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.350339 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope      = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.350629 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.350945 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.351240 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.351527 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.351800 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.352069 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.352341 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.352616 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.352897 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] nova.auth_section              = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.353186 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] nova.auth_type                 = password {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.353471 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.353741 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] nova.certfile                  = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.354016 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] nova.collect_timing            = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.354304 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] nova.endpoint_type             = public {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.354579 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] nova.insecure                  = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.354850 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] nova.keyfile                   = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.355149 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] nova.live_migration_events     = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.355434 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] nova.region_name               = RegionOne {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.355709 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] nova.split_loggers             = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.355983 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] nova.timeout                   = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.356263 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] placement.auth_section         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.356536 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] placement.auth_type            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.356799 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] placement.cafile               = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.357066 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] placement.certfile             = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.357338 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] placement.collect_timing       = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.357622 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] placement.endpoint_type        = public {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.357897 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] placement.insecure             = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.358165 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] placement.keyfile              = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.358431 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] placement.region_name          = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.358704 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] placement.split_loggers        = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.359045 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] placement.timeout              = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.359327 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.auth_section            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.359601 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.auth_type               = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.359872 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.cafile                  = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.360142 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.certfile                = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.360417 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.collect_timing          = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.360685 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.connect_retries         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.360953 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.connect_retry_delay     = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.361227 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.enable_notifications    = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.361494 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.endpoint_override       = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.361768 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.insecure                = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.362037 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.interface               = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.362306 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.keyfile                 = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.362574 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.max_version             = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.363127 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.min_version             = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.363398 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.region_name             = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.363665 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.service_name            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.363932 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.service_type            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.364205 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.split_loggers           = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.365003 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.status_code_retries     = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.365274 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.365542 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.timeout                 = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.365811 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.valid_interfaces        = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.366079 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ironic.version                 = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.366363 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.366656 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.366952 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.367228 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.367499 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.367771 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.368043 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.368314 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.368584 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.368855 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.369127 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.369410 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.369687 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.369968 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.370248 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.370521 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.370811 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.371104 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.371380 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.371700 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.371922 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.372205 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.372485 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl      = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.372773 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.373061 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.373348 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.373633 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.373920 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.374194 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.374497 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.374773 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:56.375015 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 01 09:57:56.375255 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=92456) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}}
Jun 01 09:57:56.721178 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=92456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:57:56.721451 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=92456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:57:56.721737 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=92456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:57:56.722215 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.manager [-] Loading core plugin: ml2
Jun 01 09:57:57.111219 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.111432 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.111683 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.113120 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.113393 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.113657 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.148549 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.148832 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.149097 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.162526 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.162801 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.163090 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.191763 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.192041 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.192308 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.228896 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.229174 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.229440 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.460518 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7efe73fc5ee0> agent after_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.461160 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7efe73fc5ee0> agent after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.461160 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x7efe73fc5e50> segment precommit_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.461320 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x7efe73fc5dc0> network precommit_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.462025 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x7efe73fe79d0> segment before_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.587504 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> network before_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.587824 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x7efe740590d0> agent before_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.588101 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_net of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> network before_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.588368 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> port before_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.588632 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> port before_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.588937 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> segment precommit_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.589192 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> segment precommit_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.589443 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> segment after_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.589693 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> segment after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.589982 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> network after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.590227 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> network precommit_delete 0 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.590483 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> port provisioning_complete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.590740 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> rbac-policy before_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.591020 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> rbac-policy after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.591293 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> agent after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.591560 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> subnet after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.592874 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> subnet precommit_delete 0 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.593165 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> rbac-policy before_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.593435 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> rbac-policy before_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.593728 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> segment_host_mapping after_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.594084 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> port after_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.594344 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> port after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.594597 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> port after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.594884 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> rbac-policy before_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.595162 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> rbac-policy before_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.595409 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7efe748ffd60>> rbac-policy before_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.595789 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=92456) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 09:57:57.596028 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=92456) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 09:57:57.596265 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=92456) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 09:57:57.596502 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=92456) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 09:57:57.596737 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=92456) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 09:57:57.596972 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=92456) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 09:57:57.597340 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve']
Jun 01 09:57:57.600965 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1']
Jun 01 09:57:57.604846 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
Jun 01 09:57:57.608553 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(850, 899)])])
Jun 01 09:57:57.610162 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']
Jun 01 09:57:57.610601 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'])
Jun 01 09:57:57.610963 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan']
Jun 01 09:57:57.611352 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security']
Jun 01 09:57:57.615132 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security']
Jun 01 09:57:57.615385 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security']
Jun 01 09:57:57.615729 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv']
Jun 01 09:57:57.642229 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa']
Jun 01 09:57:57.642667 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.openvswitch.driver.OVSDriver object at 0x7efe740897f0>> qos_plugin after_init 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.642988 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=92456) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}}
Jun 01 09:57:57.643347 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.openvswitch.driver.OVSDriver object at 0x7efe74089520>> logging-plugin after_init 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.644677 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=92456) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}}
Jun 01 09:57:57.644952 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv']
Jun 01 09:57:57.645194 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv']
Jun 01 09:57:57.648409 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7efe73e262b0>> floatingip before_response 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.648681 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7efe73e262b0>> port before_response 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:57.718694 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
Jun 01 09:57:57.718871 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
Jun 01 09:57:57.719144 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
Jun 01 09:57:57.719516 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)]
Jun 01 09:57:57.750943 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_db.sqlalchemy.engines [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 01 09:57:58.250456 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Initializing driver for type 'gre'
Jun 01 09:57:58.251080 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] gre ID ranges: [(1, 1000)]
Jun 01 09:57:58.478639 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Initializing driver for type 'local'
Jun 01 09:57:58.479302 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Initializing driver for type 'vlan'
Jun 01 09:57:58.627379 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] VlanTypeDriver initialization complete
Jun 01 09:57:58.627647 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Initializing driver for type 'vxlan'
Jun 01 09:57:58.628162 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] vxlan ID ranges: [(1, 1000)]
Jun 01 09:57:58.824732 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Initializing extension driver 'port_security'
Jun 01 09:57:58.825051 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.extensions.port_security [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] PortSecurityExtensionDriver initialization complete
Jun 01 09:57:58.825382 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Initializing mechanism driver 'openvswitch'
Jun 01 09:57:58.825715 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Initializing mechanism driver 'hyperv'
Jun 01 09:57:58.832209 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.plugins.ml2.plugin [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=92456) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 09:57:58.832978 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe73ed94c0>> port after_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.833350 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe73ed94c0>> port after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.833699 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe73ed94c0>> port after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.834077 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe73ed9730>> subnet after_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.834427 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe73ed9730>> subnet after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.834769 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe73ed9730>> subnet after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.835167 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe739813a0>> network after_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.835512 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe739813a0>> network after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.838230 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe739813a0>> network after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.838230 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe73981610>> security_group after_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.838230 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe73981610>> security_group after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.838230 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe73981610>> security_group after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.838640 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe739818b0>> security_group_rule after_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.838640 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe739818b0>> security_group_rule after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.838640 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe739818b0>> security_group_rule after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.838640 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe73981b20>> address_group after_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.838959 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe73981b20>> address_group after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.838959 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7efe73981b20>> address_group after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.839249 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] ML2 OVO RPC backend initialized. {{(pid=92456) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}}
Jun 01 09:57:58.839949 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_created of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7efe73981f10>> router_interface after_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.840305 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_deleted of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7efe73981f10>> router_interface after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.840725 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7efe73981f10>> network before_response 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.841071 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7efe73981f10>> networks before_response 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.841418 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7efe73981f10>> port before_response 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.841759 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7efe73981f10>> ports before_response 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.842101 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7efe73981f10>> subnet before_response 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.842441 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7efe73981f10>> subnets before_response 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.842788 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7efe73981f10>> network after_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.843178 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7efe73981f10>> network after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.843533 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7efe73981f10>> network after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.843871 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7efe73981f10>> port after_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.844224 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7efe73981f10>> port after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.844542 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7efe73981f10>> port after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.844878 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7efe73981f10>> subnet after_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.845209 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7efe73981f10>> subnet after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.845543 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7efe73981f10>> subnet after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.846109 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.plugin [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Modular L2 Plugin initialization complete
Jun 01 09:57:58.846436 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading services supported by the core plugin {{(pid=92456) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}}
Jun 01 09:57:58.846757 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.plugins.ml2.managers [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Got port-security extension from driver 'port_security'
Jun 01 09:57:58.847245 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.extensions.vlantransparent [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Disabled vlantransparent extension.
Jun 01 09:57:58.847727 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=92456) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}}
Jun 01 09:57:58.848042 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading Plugin: router
Jun 01 09:57:58.885799 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DVRResourceOperationHandler._add_csnat_on_interface_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router_interface before_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.886130 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._after_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router after_create 55549900 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.886500 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._before_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router before_create 55549900 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.886864 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router_interface before_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.887337 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DVRResourceOperationHandler._cleanup_after_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router_interface after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.887691 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._cleanup_ha_network of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router after_delete 55549900 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.888052 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DVRResourceOperationHandler._create_dvr_floating_gw_port of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> floatingip after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.888409 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router after_create 55549900 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.888754 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router after_update 55549900 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.889099 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_distributed_port_bindings_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router after_update 55549900 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.889444 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_dvr_internal_ports of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router_gateway after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.889797 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router after_update 55549900 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.890199 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DVRResourceOperationHandler._handle_distributed_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router precommit_update 55549900 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.890563 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x7efe73f9e940> port after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.890917 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x7efe73f9ea60> port after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.891256 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x7efe73f9e9d0> subnet after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.891587 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x7efe73f9e820> subnetpool_address_scope after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.891932 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> port precommit_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.892276 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._precommit_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router precommit_create 55549900 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.892617 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x7efe73f92430> port before_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.892962 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router precommit_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.893317 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._reconfigure_ha_resources of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router after_update 55549900 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.893655 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._release_router_vr_id of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router precommit_delete 55549900 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.893999 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DVRResourceOperationHandler._set_distributed_flag of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router precommit_create 55549900 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.894355 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router_interface after_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.894696 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._validate_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> router precommit_update 55549900 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.895122 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7efe739816a0>> network after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.895999 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Tracking information for resource: router configured {{(pid=92456) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 09:57:58.896326 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Tracking information for resource: floatingip configured {{(pid=92456) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 09:57:58.901213 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.db.l3_agentschedulers_db [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled.
Jun 01 09:57:58.901784 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <function _notify_l3_agent_port_update at 0x7efe738fce50> port after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.902139 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <function _notify_l3_agent_new_port at 0x7efe738fcd30> port after_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.902486 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <function _notify_port_delete at 0x7efe738fcdc0> port after_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.902833 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <function _notify_l3_agent_ha_port_update at 0x7efe738ff160> port after_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.903650 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7efe739248b0>> router before_create 55550100 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.904011 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7efe739248b0>> router precommit_delete 55550100 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.904369 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7efe739248b0>> router precommit_create 55550100 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.904723 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7efe739248b0>> router precommit_update 55550100 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.909175 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.services.provider_configuration [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Service providers = [] {{(pid=92456) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}}
Jun 01 09:57:58.909539 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.db.servicetype_db [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=92456) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
Jun 01 09:57:58.912468 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.services.service_base [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=92456) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 09:57:58.912812 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.services.service_base [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=92456) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 09:57:58.913148 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.services.service_base [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=92456) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 09:57:58.914011 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.services.service_base [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=92456) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 09:57:58.914377 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.services.service_base [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Default provider is not specified for service type L3_ROUTER_NAT
Jun 01 09:57:58.914941 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=92456) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 09:57:58.915246 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin
Jun 01 09:57:58.925505 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=92456) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 09:57:58.925837 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading Plugin: auto_allocate
Jun 01 09:57:58.932057 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7efe73948550> network precommit_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.932419 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7efe73948550> network precommit_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.932928 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=92456) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 09:57:58.933243 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading Plugin: tag
Jun 01 09:57:58.940018 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=92456) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 09:57:58.940345 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading Plugin: timestamp
Jun 01 09:57:58.944634 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=92456) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 09:57:58.944963 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading Plugin: network_ip_availability
Jun 01 09:57:58.950144 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7efe73942e80>> rbac-policy before_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.950510 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7efe73942e80>> rbac-policy before_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.950863 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7efe73942e80>> rbac-policy before_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:58.951599 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=92456) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 09:57:58.951915 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading Plugin: flavors
Jun 01 09:57:58.956784 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=92456) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 09:57:58.957111 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading Plugin: revisions
Jun 01 09:57:58.961360 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=92456) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 09:57:58.961748 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_concurrency.lockutils [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 2.240s {{(pid=92456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:57:58.962539 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=92456) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}}
Jun 01 09:57:58.962814 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Initializing extension manager.
Jun 01 09:57:58.963338 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: __init__.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.963679 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: __pycache__ {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.964011 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.964348 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: address_group.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.965089 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.965656 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: address-group
Jun 01 09:57:58.965977 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: address_scope.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.966682 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.967219 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: address-scope
Jun 01 09:57:58.967543 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: admin_state_down_before_update.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.968455 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.968962 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: router-admin-state-down-before-update
Jun 01 09:57:58.969282 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: agent.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.969965 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.970465 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: agent
Jun 01 09:57:58.970781 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: agent_resources_synced.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.971696 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.972199 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: agent-resources-synced
Jun 01 09:57:58.972517 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: allowedaddresspairs.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.974797 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.975342 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: allowed-address-pairs
Jun 01 09:57:58.975661 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: auto_allocated_topology.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.976719 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.977254 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: auto-allocated-topology
Jun 01 09:57:58.977789 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: availability_zone.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.978896 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.979698 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: availability_zone
Jun 01 09:57:58.980025 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: availability_zone_filter.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.980939 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.981448 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: availability_zone_filter
Jun 01 09:57:58.981772 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: data_plane_status.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.982664 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.983493 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension data-plane-status not supported by any of loaded plugins
Jun 01 09:57:58.984029 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: default_subnetpools.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.985469 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.986141 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: default-subnetpools
Jun 01 09:57:58.986468 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: dhcpagentscheduler.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.987319 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.988085 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: dhcp_agent_scheduler
Jun 01 09:57:58.988414 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: dns.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.989327 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.990576 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension dns-integration not supported by any of loaded plugins
Jun 01 09:57:58.990897 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: dns_domain_ports.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.991823 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.992323 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension dns-domain-ports not supported by any of loaded plugins
Jun 01 09:57:58.992643 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: dvr.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.993309 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.993807 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: dvr
Jun 01 09:57:58.994125 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: empty_string_filtering.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.995051 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.995556 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: empty-string-filtering
Jun 01 09:57:58.995875 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.996767 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.997268 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
Jun 01 09:57:58.997583 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:58.998472 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:58.998996 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
Jun 01 09:57:58.999319 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: external_net.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.000209 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.000884 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: external-net
Jun 01 09:57:59.001247 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: extra_dhcp_opt.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.002103 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.002604 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: extra_dhcp_opt
Jun 01 09:57:59.002938 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: extraroute.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.003824 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.004323 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: extraroute
Jun 01 09:57:59.004638 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: extraroute_atomic.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.005687 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.006190 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: extraroute-atomic
Jun 01 09:57:59.006505 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: filter_validation.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.007378 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.007873 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: filter-validation
Jun 01 09:57:59.008187 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: fip_pf_description.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.009266 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.010373 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
Jun 01 09:57:59.010701 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: fip_port_details.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.012028 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.012538 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: fip-port-details
Jun 01 09:57:59.012856 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: flavors.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.014080 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.014588 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: flavors
Jun 01 09:57:59.015318 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.017357 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.017866 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
Jun 01 09:57:59.018194 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: floatingip_pools.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.018880 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.019471 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: floatingip-pools
Jun 01 09:57:59.020556 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: ip_allocation.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.021518 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.022031 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension ip_allocation not supported by any of loaded plugins
Jun 01 09:57:59.022355 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.023293 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.023801 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: ip-substring-filtering
Jun 01 09:57:59.024122 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: l2_adjacency.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.025817 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.026330 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension l2_adjacency not supported by any of loaded plugins
Jun 01 09:57:59.026657 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: l3.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.027671 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.028193 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: router
Jun 01 09:57:59.028519 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: l3_conntrack_helper.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.030749 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.031313 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension l3-conntrack-helper not supported by any of loaded plugins
Jun 01 09:57:59.031643 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.032562 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.033079 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: ext-gw-mode
Jun 01 09:57:59.033403 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.034305 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.034808 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: l3-ha
Jun 01 09:57:59.035167 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: l3_flavors.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.036060 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.037098 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: l3-flavors
Jun 01 09:57:59.037457 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.038328 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.038822 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: l3-port-ip-change-not-allowed
Jun 01 09:57:59.039178 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: l3agentscheduler.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.040192 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.040697 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: l3_agent_scheduler
Jun 01 09:57:59.041014 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: logging.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.042489 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.043042 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension logging not supported by any of loaded plugins
Jun 01 09:57:59.043366 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: metering.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.044095 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.044670 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: metering
Jun 01 09:57:59.044990 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.046061 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.046569 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: metering_source_and_destination_fields
Jun 01 09:57:59.046889 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: multiprovidernet.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.047943 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.048455 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: multi-provider
Jun 01 09:57:59.048780 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: netmtu.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.049678 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.050179 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: net-mtu
Jun 01 09:57:59.050496 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: netmtu_writable.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.051416 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.051915 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: net-mtu-writable
Jun 01 09:57:59.052785 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: network_availability_zone.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.053441 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.053945 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: network_availability_zone
Jun 01 09:57:59.054264 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: network_ip_availability.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.055376 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.055889 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: network-ip-availability
Jun 01 09:57:59.056209 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: network_segment_range.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.056965 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.057468 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension network-segment-range not supported by any of loaded plugins
Jun 01 09:57:59.057785 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: pagination.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.058755 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.059118 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: pagination
Jun 01 09:57:59.059440 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: port_device_profile.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.060333 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.060848 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: port-device-profile
Jun 01 09:57:59.061166 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.062062 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.062568 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: port-mac-address-regenerate
Jun 01 09:57:59.062892 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.063804 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.064439 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: port-numa-affinity-policy
Jun 01 09:57:59.064627 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: port_resource_request.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.065526 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.066025 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension port-resource-request not supported by any of loaded plugins
Jun 01 09:57:59.066343 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: portbindings.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.067283 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.067866 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: binding
Jun 01 09:57:59.068187 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: portbindings_extended.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.069450 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.069956 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: binding-extended
Jun 01 09:57:59.070278 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: portsecurity.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.071212 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.071723 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: port-security
Jun 01 09:57:59.072042 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: project_id.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.073000 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.073328 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: project-id
Jun 01 09:57:59.073646 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: providernet.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.074545 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.075089 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: provider
Jun 01 09:57:59.075408 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: qos.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.078884 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.079427 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension qos not supported by any of loaded plugins
Jun 01 09:57:59.079756 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.080983 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.081493 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
Jun 01 09:57:59.081815 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.082720 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.083254 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
Jun 01 09:57:59.083597 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: qos_default.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.084495 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.085008 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension qos-default not supported by any of loaded plugins
Jun 01 09:57:59.085329 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: qos_fip.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.085966 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.086465 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension qos-fip not supported by any of loaded plugins
Jun 01 09:57:59.086786 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: qos_gateway_ip.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.087718 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.088223 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension qos-gateway-ip not supported by any of loaded plugins
Jun 01 09:57:59.088541 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: qos_port_network_policy.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.089436 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.089936 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension qos-port-network-policy not supported by any of loaded plugins
Jun 01 09:57:59.090255 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: qos_rule_type_details.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.091172 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.091671 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension qos-rule-type-details not supported by any of loaded plugins
Jun 01 09:57:59.091986 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: qos_rules_alias.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.093003 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.093503 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension qos-rules-alias not supported by any of loaded plugins
Jun 01 09:57:59.093822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: quotasv2.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.094847 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.095204 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: quotas
Jun 01 09:57:59.095525 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: quotasv2_detail.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.097118 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.097454 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: quota_details
Jun 01 09:57:59.097776 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: rbac.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.098812 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.099877 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: rbac-policies
Jun 01 09:57:59.100201 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: rbac_address_group.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.101111 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.101622 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: rbac-address-group
Jun 01 09:57:59.101941 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: rbac_address_scope.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.102846 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.103374 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: rbac-address-scope
Jun 01 09:57:59.103692 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: rbac_security_groups.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.104595 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.105106 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: rbac-security-groups
Jun 01 09:57:59.105426 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: rbac_subnetpool.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.106340 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.106836 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: rbac-subnetpool
Jun 01 09:57:59.107184 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: revisionifmatch.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.108084 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.108588 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: revision-if-match
Jun 01 09:57:59.108905 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: revisions.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.109996 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.110503 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: standard-attr-revisions
Jun 01 09:57:59.110822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: router_availability_zone.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.111514 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.112021 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: router_availability_zone
Jun 01 09:57:59.112340 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: routerservicetype.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.113501 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.114011 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension router-service-type not supported by any of loaded plugins
Jun 01 09:57:59.114330 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.115807 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.116318 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: security-groups-normalized-cidr
Jun 01 09:57:59.116636 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: security_groups_port_filtering.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.117546 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.118053 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: port-security-groups-filtering
Jun 01 09:57:59.118370 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.119301 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.119807 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: security-groups-remote-address-group
Jun 01 09:57:59.120123 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: securitygroup.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.129612 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.130130 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: security-group
Jun 01 09:57:59.130503 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: segment.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.131311 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.131813 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension segment not supported by any of loaded plugins
Jun 01 09:57:59.132136 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.133059 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.133562 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
Jun 01 09:57:59.133881 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: servicetype.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.135000 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.135516 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: service-type
Jun 01 09:57:59.135880 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: sorting.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.136799 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.137130 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: sorting
Jun 01 09:57:59.137490 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: standard_attr_segment.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.138351 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.138859 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension standard-attr-segment not supported by any of loaded plugins
Jun 01 09:57:59.139206 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: standardattrdescription.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.139836 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.140334 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: standard-attr-description
Jun 01 09:57:59.140651 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: stateful_security_group.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.141550 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.142060 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: stateful-security-group
Jun 01 09:57:59.142380 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: stdattrs_common.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.142969 dv-cinder-787262-4-iscsi neutron-server[92456]: WARNING neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
Jun 01 09:57:59.143290 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.144302 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.144809 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins
Jun 01 09:57:59.145130 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: subnet_onboard.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.146356 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.146865 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: subnet_onboard
Jun 01 09:57:59.147209 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.148207 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.148711 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
Jun 01 09:57:59.149029 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: subnet_service_types.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.150058 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.150581 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: subnet-service-types
Jun 01 09:57:59.150926 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: subnetallocation.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.151997 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.152517 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: subnet_allocation
Jun 01 09:57:59.152845 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.153490 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.153993 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: subnetpool-prefix-ops
Jun 01 09:57:59.154308 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.155259 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.155766 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
Jun 01 09:57:59.156081 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: tagging.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.157126 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.157634 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: standard-attr-tag
Jun 01 09:57:59.157953 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: timestamp.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.159171 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.159679 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loaded extension: standard-attr-timestamp
Jun 01 09:57:59.160002 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: trunk.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.161011 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.162055 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension trunk not supported by any of loaded plugins
Jun 01 09:57:59.162376 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: trunk_details.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.163315 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.163817 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension trunk-details not supported by any of loaded plugins
Jun 01 09:57:59.164136 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: uplink_status_propagation.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.165040 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.165540 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension uplink-status-propagation not supported by any of loaded plugins
Jun 01 09:57:59.165857 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Loading extension file: vlantransparent.py {{(pid=92456) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 09:57:59.166503 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=92456) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 09:57:59.167042 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extension vlan-transparent not supported by any of loaded plugins
Jun 01 09:57:59.169467 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of TrackedResource for resource:network
Jun 01 09:57:59.170194 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of TrackedResource for resource:subnet
Jun 01 09:57:59.172063 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 09:57:59.172698 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of TrackedResource for resource:port
Jun 01 09:57:59.173975 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.v2.resource_helper [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92456) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 09:57:59.174410 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.v2.resource_helper [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Service FLAVORS assigned prefix:  {{(pid=92456) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 09:57:59.175065 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.v2.resource_helper [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92456) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 09:57:59.175509 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.v2.resource_helper [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92456) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 09:57:59.175840 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of TrackedResource for resource:router
Jun 01 09:57:59.176498 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of TrackedResource for resource:floatingip
Jun 01 09:57:59.177753 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.v2.resource_helper [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Service METERING assigned prefix: /metering {{(pid=92456) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 09:57:59.179207 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7efe7381c3d0>> rbac-policy before_create 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:59.179574 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7efe7381c3d0>> rbac-policy before_update 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:59.179925 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7efe7381c3d0>> rbac-policy before_delete 55550000 {{(pid=92456) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 09:57:59.181066 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of CountableResource for resource:rbac_policy
Jun 01 09:57:59.181517 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of TrackedResource for resource:security_group
Jun 01 09:57:59.182184 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of TrackedResource for resource:security_group_rule
Jun 01 09:57:59.182948 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.v2.resource_helper [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Service CORE assigned prefix:  {{(pid=92456) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 09:57:59.183280 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 09:57:59.183613 dv-cinder-787262-4-iscsi neutron-server[92456]: WARNING neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] subnetpool is already registered
Jun 01 09:57:59.184223 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.v2.resource_helper [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Service CORE assigned prefix:  {{(pid=92456) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 09:57:59.184550 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 09:57:59.184874 dv-cinder-787262-4-iscsi neutron-server[92456]: WARNING neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] subnetpool is already registered
Jun 01 09:57:59.187414 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.v2.resource_helper [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92456) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 09:57:59.187849 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.v2.resource_helper [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Service FLAVORS assigned prefix:  {{(pid=92456) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 09:57:59.188443 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.v2.resource_helper [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92456) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 09:57:59.188861 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.v2.resource_helper [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=92456) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 09:57:59.189191 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of TrackedResource for resource:router
Jun 01 09:57:59.189514 dv-cinder-787262-4-iscsi neutron-server[92456]: WARNING neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] router is already registered
Jun 01 09:57:59.190102 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of TrackedResource for resource:floatingip
Jun 01 09:57:59.190426 dv-cinder-787262-4-iscsi neutron-server[92456]: WARNING neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] floatingip is already registered
Jun 01 09:57:59.191078 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.v2.resource_helper [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Service METERING assigned prefix: /metering {{(pid=92456) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 09:57:59.191755 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of CountableResource for resource:rbac_policy
Jun 01 09:57:59.192077 dv-cinder-787262-4-iscsi neutron-server[92456]: WARNING neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] rbac_policy is already registered
Jun 01 09:57:59.192626 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of TrackedResource for resource:security_group
Jun 01 09:57:59.192979 dv-cinder-787262-4-iscsi neutron-server[92456]: WARNING neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] security_group is already registered
Jun 01 09:57:59.193568 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of TrackedResource for resource:security_group_rule
Jun 01 09:57:59.193902 dv-cinder-787262-4-iscsi neutron-server[92456]: WARNING neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] security_group_rule is already registered
Jun 01 09:57:59.194575 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.v2.resource_helper [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Service CORE assigned prefix:  {{(pid=92456) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 09:57:59.194912 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 09:57:59.195242 dv-cinder-787262-4-iscsi neutron-server[92456]: WARNING neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] subnetpool is already registered
Jun 01 09:57:59.195845 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.v2.resource_helper [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Service CORE assigned prefix:  {{(pid=92456) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 09:57:59.196169 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 09:57:59.196488 dv-cinder-787262-4-iscsi neutron-server[92456]: WARNING neutron.quota.resource_registry [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] subnetpool is already registered
Jun 01 09:57:59.197116 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: extensions {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.198576 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: address-groups {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.200217 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: address-scopes {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.201410 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: agents {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.202560 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: auto-allocated-topology {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.203829 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: availability_zones {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.205138 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: dhcp-networks {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.206552 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: dhcp-agents {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.208005 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: routers {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.209818 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: flavors {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.211019 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: service_profiles {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.212230 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: next_providers {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.213756 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: service_profiles {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.215235 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: floatingip-pools {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.216450 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: routers {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.218241 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: floatingips {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.219468 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: l3-routers {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.220843 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: l3-agents {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.222244 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: metering-labels {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.223628 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: metering-label-rules {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.225442 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: network-ip-availabilities {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.226680 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: bindings {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.228363 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: quotas {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.229792 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: quotas {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.231225 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: rbac-policies {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.232511 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: security-groups {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.233720 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: security-group-rules {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.234950 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: service-providers {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.236169 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: subnetpools {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.238803 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: subnetpools {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.240841 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: tags {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.242539 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: tags {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.358347 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: tags {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.360195 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: tags {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.361948 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: tags {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.364204 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: tags {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.367128 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: tags {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.369438 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: tags {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.372074 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: tags {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.373959 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron.api.extensions [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Extended resource: tags {{(pid=92456) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 09:57:59.379859 dv-cinder-787262-4-iscsi neutron-server[92456]: WARNING keystonemiddleware.auth_token [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True.
Jun 01 09:57:59.384675 dv-cinder-787262-4-iscsi neutron-server[92456]: WARNING keystonemiddleware.auth_token [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Jun 01 09:57:59.393062 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_concurrency.lockutils [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Acquired lock "singleton_lock" {{(pid=92456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
Jun 01 09:57:59.393478 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_concurrency.lockutils [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Releasing lock "singleton_lock" {{(pid=92456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
Jun 01 09:57:59.394104 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO oslo_service.service [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Starting 2 workers
Jun 01 09:57:59.399418 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Started child 92565 {{(pid=92456) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 09:57:59.403775 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Started child 92566 {{(pid=92456) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 09:57:59.404448 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:57:59.405389 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO neutron.service [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Neutron service started, listening on 0.0.0.0:9696
Jun 01 09:57:59.405928 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [-] (92565) wsgi starting up on http://0.0.0.0:9696
Jun 01 09:57:59.406042 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Notify callbacks [] for process, before_spawn {{(pid=92456) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:57:59.408419 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO oslo_service.service [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Starting 1 workers
Jun 01 09:57:59.408676 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:57:59.410065 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [-] (92566) wsgi starting up on http://0.0.0.0:9696
Jun 01 09:57:59.414156 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Started child 92567 {{(pid=92456) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 09:57:59.415296 dv-cinder-787262-4-iscsi neutron-server[92456]: INFO oslo_service.service [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Starting 1 workers
Jun 01 09:57:59.417740 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.service [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] calling RpcWorker wait() {{(pid=92567) _wait /opt/stack/neutron/neutron/service.py:128}}
Jun 01 09:57:59.418284 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.service [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] returning from RpcWorker wait() {{(pid=92567) _wait /opt/stack/neutron/neutron/service.py:135}}
Jun 01 09:57:59.419071 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Started child 92568 {{(pid=92456) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 09:57:59.419460 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:57:59.419833 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG neutron_lib.callbacks.manager [None req-b5cfd640-cb30-427a-9381-af3f8bb920b3 None None] Notify callbacks [] for process, after_spawn {{(pid=92456) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:57:59.420034 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 09:57:59.421664 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=92456) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
Jun 01 09:57:59.421872 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 01 09:57:59.422058 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 01 09:57:59.422273 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 01 09:57:59.422609 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 01 09:57:59.422769 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 01 09:57:59.423463 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.423735 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:57:59.424205 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.424205 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.424337 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.424561 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.424651 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 09:57:59.425130 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.425419 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.425671 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.425945 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.426204 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.426377 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.426541 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.426792 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.427080 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.427469 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.427765 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.428002 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.428270 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.428447 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.428695 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.428966 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.429193 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.429459 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] debug                          = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.429697 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.430336 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.430562 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.430805 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.431048 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.431336 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.431564 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.431846 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.432084 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.432306 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.432525 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.432797 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.433038 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.433268 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.433505 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.433753 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.433967 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.434472 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] host                           = dv-cinder-787262-4-iscsi {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.434713 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.434951 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.435215 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.435485 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.435717 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.435932 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.436183 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.436428 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.436668 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.436909 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.437219 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.437380 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.437602 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.437856 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.438019 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.438234 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.438507 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.438774 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.438998 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.439170 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.439352 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.439604 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.439754 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.440002 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.440234 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.440452 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.440665 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.440895 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.441122 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.441440 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.441590 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.441810 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.442034 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.442274 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.442518 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.442788 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.443042 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.443275 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.443488 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.443719 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.443931 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.444177 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.444405 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.444615 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.444872 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.445115 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.445358 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.445611 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.445854 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.446080 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.446315 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.446506 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.446765 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.447031 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.447322 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.447544 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.447757 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.447997 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.448210 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.448421 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.448670 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.448881 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.449168 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.449341 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.449557 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.449855 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.450005 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.450221 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.450454 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.450883 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.451175 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.451575 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.451734 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.451985 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.452240 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.452489 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.452709 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.452940 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.453187 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.453512 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.453741 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.454042 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.454271 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.454513 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.454840 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.455126 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.455407 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.455632 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.455873 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.456116 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.456342 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.456679 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.456940 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.457238 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.68/identity {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.457496 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.457729 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.457950 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.458166 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.458940 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.464034 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.464034 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.464034 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.464034 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.464034 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.464034 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.464034 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.464034 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.464034 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.465118 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.465118 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.465118 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.465118 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.465118 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.465118 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.465118 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.465118 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.465118 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.466126 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.466126 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.466126 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.466126 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.466126 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.466126 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.466126 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.466126 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.466126 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.467147 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.467147 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.467147 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.467147 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.467147 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.467715 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.467715 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.467942 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.468069 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.468185 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.468379 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.468606 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.469110 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.469110 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.469449 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.469449 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.469704 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.469902 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.470096 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.470368 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.470569 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.470767 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.471290 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.471290 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.471669 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.471669 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.472449 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.472449 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.472754 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.472754 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.473139 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.473328 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.473542 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.473742 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.473922 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.474794 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.475064 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.475301 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.475559 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.475806 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.476040 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.476295 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.476539 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.476816 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.477060 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.477283 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.477533 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.477763 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.477983 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.478281 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.478527 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.478759 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.479710 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.479710 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.480116 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.480116 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.480496 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.480496 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.480862 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.481238 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.481430 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.481624 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.481823 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.482118 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.482359 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.482569 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.482766 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.483028 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.483262 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.483474 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.483738 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.483970 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.484187 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.484410 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.484624 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.484938 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.485186 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.485411 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.485638 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.485853 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.486074 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.486286 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.486613 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.486828 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.487096 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.487304 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.487523 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.68/identity {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.487735 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.488179 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.488383 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.488594 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.488829 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.490954 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.490954 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.490954 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.490954 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.490954 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.490954 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.490954 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.490954 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.491993 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.491993 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.491993 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.491993 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.491993 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.491993 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.492738 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.492738 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.492738 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.492738 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.493242 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.493242 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.493511 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.493661 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.493881 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.494112 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.494868 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.494868 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.494868 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.495619 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.495619 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.495619 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.496170 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.496170 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.496170 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.496694 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.496694 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.497028 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.497028 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.497984 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.497984 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.497984 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.497984 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.500745 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.500745 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.500745 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.500745 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.500745 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.500745 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.500745 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.500745 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.502328 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.502328 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.502328 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.502328 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.502328 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.502328 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.502328 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.502328 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.504690 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.504690 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.504690 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.504690 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.504690 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.504690 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.504690 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.504690 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.506263 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.506263 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.506263 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.506263 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.506263 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.506263 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.506263 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.506263 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.506263 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.508650 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.508650 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.508650 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.508650 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.508650 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.508650 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.508650 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.508650 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.509822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.509822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.509822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.509822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.509822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.509822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.509822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.509822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.510810 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.510810 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.510810 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.510810 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.510810 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.510810 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.510810 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.511673 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.511673 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.511673 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.511673 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.512276 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:850:899'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.512276 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.512525 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.512760 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.513010 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.513286 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.513541 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.513764 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.514025 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.514468 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.514468 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.514668 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.514934 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.515138 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.515399 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.515628 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.515851 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.516115 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.516287 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.516521 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.516746 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.516985 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.517204 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.517440 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.517579 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 01 09:57:59.518141 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=92456) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
Jun 01 09:57:59.518303 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 01 09:57:59.518454 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 01 09:57:59.518642 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 01 09:57:59.518805 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 01 09:57:59.518980 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 01 09:57:59.519186 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.519344 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.519503 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.519661 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.519821 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.519999 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.520155 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.520311 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.520466 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.520620 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.521300 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.521471 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.521624 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.521781 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.521937 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.522094 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.522250 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.522406 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.522566 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.522724 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.522888 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.523055 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.523191 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] debug                          = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.523349 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.523522 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.523664 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.523825 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.523981 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.524135 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.524288 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.524443 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.524597 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.524752 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.524906 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.525062 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.525217 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.525373 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.525530 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.525686 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.525840 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.525995 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] host                           = dv-cinder-787262-4-iscsi {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.526149 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.526303 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.526459 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.526613 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.526767 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.526942 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.527098 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.527253 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.527407 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.527562 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.527715 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.527874 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.528030 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.528183 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.528338 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.528493 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.528647 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.528801 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.528975 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.529136 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.529291 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.529445 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.529601 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.529758 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.529922 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.530055 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.530190 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.530351 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.530556 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.530766 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.530766 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.531231 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.531231 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.531231 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.532513 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.532513 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.532513 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.532513 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.532513 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.532513 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.532513 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.533602 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.533602 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.533602 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.533602 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.533602 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.533602 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.533602 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.533602 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.534710 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.534710 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.534710 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.534710 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.534710 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.534710 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.534710 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.535834 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.535834 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.535834 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.535834 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.535834 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.535834 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.535834 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.535834 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.537938 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.537938 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.537938 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.537938 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.537938 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 09:57:59.537938 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.537938 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.537938 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.538770 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.538770 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.538770 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.538770 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.538770 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.538770 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.538770 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.538770 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.539860 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.539860 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.539860 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.539860 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.539860 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.539860 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.539860 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.540822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.540822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.540822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.540822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.540822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.540822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.540822 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.68/identity {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.541564 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.541564 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.541564 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.541564 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.541564 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.542206 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.542206 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.542206 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.542206 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.542805 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.542805 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.542805 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.542805 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.543535 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.543535 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.543535 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.543535 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.543535 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.544103 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.544103 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.544103 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.544103 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.544611 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.544611 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.544611 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.544959 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.544959 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.545256 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.545256 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.545526 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.545526 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.545867 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.545867 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.545867 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.546247 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.546247 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.546467 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.546467 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.546702 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.546819 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.546982 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.547108 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.547276 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.547470 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.547632 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.547750 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.547878 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.548021 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.548182 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.548340 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.548500 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.548658 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.548818 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.548982 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.549177 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.549375 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.549492 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.549600 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.549711 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.549898 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.550090 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.550314 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.550314 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.550760 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.550760 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.550760 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.551365 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.551365 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.551365 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.551809 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.551809 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.551809 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.551809 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.552373 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.552373 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.552373 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.552821 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.552821 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.552821 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.553308 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.553308 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.553308 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.553308 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.554009 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.554009 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.554009 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.554009 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.554627 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.554627 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.554627 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.554627 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.555174 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.555174 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.555174 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.555174 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.555786 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.555786 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.555786 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.555786 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.556217 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.556217 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.556217 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.556553 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.556553 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.556776 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.556776 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.557000 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.557117 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.557233 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.557397 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.557580 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.557738 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.557857 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.557976 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.558140 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.558299 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.558458 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.558617 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.558809 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.68/identity {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.558955 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.558955 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.559348 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.559465 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.559581 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.559698 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.559842 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.560002 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.560161 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.560320 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.560478 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.560644 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.560852 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.561013 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.561161 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.561308 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.561455 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.561610 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.561757 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.561926 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.562090 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.562238 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.562383 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.562529 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.562677 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.562834 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.563068 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.563068 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.563352 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.563352 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.563642 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.563642 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.563922 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.563922 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.564218 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.564218 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.564441 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.564559 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.564742 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.564918 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.564918 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.565255 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.565255 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.566077 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.566077 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.566077 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.566077 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.566859 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.566859 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.566859 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.566859 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.566859 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.566859 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.568049 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.568049 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.568049 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.568049 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.568049 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.568049 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.568049 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.569291 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.569291 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.569291 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.569291 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.569291 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.569291 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.569291 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.569291 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.569291 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.571545 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.571545 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.571545 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.571545 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.571545 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.571545 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.571545 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.571545 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.571545 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.572920 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.572920 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.572920 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.572920 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.572920 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.572920 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.572920 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.572920 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.572920 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.573875 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.574003 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 55148) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 09:57:59.574124 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.574124 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.574124 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.574124 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.574124 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.574124 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.574124 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.574124 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.575235 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.575235 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.575235 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.575235 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.575235 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.575235 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.575235 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.575235 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.576080 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.576080 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.576080 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:850:899'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.576080 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.576080 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.576080 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.576080 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.576080 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.576934 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.576934 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.576934 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.576934 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.576934 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.576934 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.576934 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.577684 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.577684 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.577684 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.577684 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.577684 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.578220 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.578220 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.578220 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.578220 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.578643 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.578643 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 09:57:59.578643 dv-cinder-787262-4-iscsi neutron-server[92456]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=92456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 01 09:57:59.583166 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [-] 10.222.0.68 "GET / HTTP/1.1" status: 200  len: 253 time: 0.0087266
Jun 01 09:57:59.596914 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 09:58:10.572165 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-31226c61-8cf3-446f-b94b-6cd12700e06e None None] get_active_networks_info from dv-cinder-787262-4-iscsi {{(pid=92567) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}}
Jun 01 09:58:10.656308 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31226c61-8cf3-446f-b94b-6cd12700e06e None None] No non-hosted networks {{(pid=92567) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}}
Jun 01 09:58:10.665226 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.agentschedulers_db [None req-31226c61-8cf3-446f-b94b-6cd12700e06e None None] DHCP Agent not found on host dv-cinder-787262-4-iscsi {{(pid=92567) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}}
Jun 01 09:58:10.794199 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-d212b6dd-f1a7-4835-b285-0e5ca40f0ae9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510'] for agent, after_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:12.964436 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-6378c7dc-6ec0-4706-b111-8803a7b56703 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510'] for agent, after_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:13.026555 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.db.api [None req-23fa9336-cc22-4f3b-9e3a-f032f48b354c None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agents.uniq_agents0agent_type0host'] with value(s) L3 agent-dv-cinder-787262-4-iscsi {{(pid=92567) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
Jun 01 09:58:13.027229 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_db.api [None req-23fa9336-cc22-4f3b-9e3a-f032f48b354c None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
Jun 01 09:58:13.236547 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510'] for agent, after_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:13.237396 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:13.238163 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:13.238630 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:13.239119 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:13.239586 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:13.240076 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:13.240555 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:13.241040 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:13.241499 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:13.241998 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:13.242475 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:13.242963 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:13.243486 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7efe72bece20>, 'Open vSwitch agent', 'dv-cinder-787262-4-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 09:58:13.253044 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7efe72c6db50>,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-787262-4-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 09:58:13.625444 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-23fa9336-cc22-4f3b-9e3a-f032f48b354c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:13.991644 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510'] for agent, after_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:15.725390 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510'] for agent, after_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:17.318775 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 55244) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 09:58:17.890552 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.db.l3_hamode_db [None req-237889ac-6076-4fef-b3ff-ad8f586baac7 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1
Jun 01 09:58:17.917486 dv-cinder-787262-4-iscsi neutron-server[92566]: WARNING oslo_policy.policy [None req-20991602-e2eb-47b7-a0bb-cba4d2167d76 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 09:58:17.918081 dv-cinder-787262-4-iscsi neutron-server[92566]: WARNING oslo_policy.policy [None req-20991602-e2eb-47b7-a0bb-cba4d2167d76 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 09:58:17.982545 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-237889ac-6076-4fef-b3ff-ad8f586baac7 None None] Routers set() bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 09:58:17.982943 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-237889ac-6076-4fef-b3ff-ad8f586baac7 None None] Router IDs set() for agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}}
Jun 01 09:58:18.138602 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [None req-20991602-e2eb-47b7-a0bb-cba4d2167d76 admin admin] http://10.222.0.68:9696/v2.0/extensions returned with HTTP 200 {{(pid=92566) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 09:58:18.139673 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-20991602-e2eb-47b7-a0bb-cba4d2167d76 admin admin] 10.222.0.68 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.8199646
Jun 01 09:58:20.447289 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 55258) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 09:58:20.807583 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-a1b9ce2c-d3c1-4cb6-a088-1f929e085fc1 admin admin] Request body: {'subnetpool': {'prefixes': ['172.20.0.0/16'], 'default_prefixlen': 26, 'shared': True, 'is_default': True, 'name': 'shared-default-subnetpool-v4'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 09:58:20.905770 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.policy [None req-a1b9ce2c-d3c1-4cb6-a088-1f929e085fc1 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=92566) register_rules /opt/stack/neutron/neutron/policy.py:73}}
Jun 01 09:58:20.950472 dv-cinder-787262-4-iscsi neutron-server[92566]: WARNING oslo_policy.policy [None req-a1b9ce2c-d3c1-4cb6-a088-1f929e085fc1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 09:58:20.950830 dv-cinder-787262-4-iscsi neutron-server[92566]: WARNING oslo_policy.policy [None req-a1b9ce2c-d3c1-4cb6-a088-1f929e085fc1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 09:58:20.959169 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.quota [None req-a1b9ce2c-d3c1-4cb6-a088-1f929e085fc1 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7efe7323daf0>.
Jun 01 09:58:20.974701 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-a1b9ce2c-d3c1-4cb6-a088-1f929e085fc1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 09:58:21.170352 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a1b9ce2c-d3c1-4cb6-a088-1f929e085fc1 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8726962385763', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8726962385100', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8726962398938', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8726962401910', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8726962481161', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8726962474937', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-7813768', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-567050', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-7936564', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-7881953'] for rbac-policy, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:21.490225 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a1b9ce2c-d3c1-4cb6-a088-1f929e085fc1 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:21.491461 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-a1b9ce2c-d3c1-4cb6-a088-1f929e085fc1 admin admin] 10.222.0.68 "POST /v2.0/subnetpools HTTP/1.1" status: 201  len: 739 time: 1.0432057
Jun 01 09:58:24.128239 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 55272) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 09:58:24.491360 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Request body: {'network': {'tenant_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'project_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'admin_state_up': True, 'name': 'private'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 09:58:24.491360 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 09:58:24.493882 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Usage tracker for resource:network and tenant:b128dfeba3994ccf96e2a972cb8dea59 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 09:58:24.498368 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 09:58:24.504360 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 09:58:24.665133 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Made reservation on behalf of b128dfeba3994ccf96e2a972cb8dea59 for: {'network': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 09:58:24.668007 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:24.685539 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:24.699733 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 09:58:24.703454 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Usage tracker for resource:security_group_rule and tenant:b128dfeba3994ccf96e2a972cb8dea59 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 09:58:24.708510 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 09:58:24.715002 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 09:58:24.811759 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:24.876367 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:24.880828 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:58:24.899893 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 854}  {{(pid=92566) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 09:58:24.926798 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8726958294501', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:24.926798 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7efe73fc5e50> segment precommit_create {{(pid=92566) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
Jun 01 09:58:24.926798 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.segments_db [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Added segment 8e496b3d-da2d-4b83-9bb7-392d8374523a of type vlan for network afca1f9e-5b29-470b-8bde-2b34d97ce2af
Jun 01 09:58:24.975066 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7dabdc62-38a0-4b0f-b06c-670b538d920e,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:58:24.996456 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:24.996810 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:24.997145 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:24.997469 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:24.997789 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:24.998122 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:24.998442 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:24.998757 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:24.999112 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:24.999429 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:24.999739 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:25.000054 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Tracked resource versions report:
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]: pushed versions:
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]: {   'AddressGroup': {'1.2'},
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:     'ConntrackHelper': {'1.0'},
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:     'Log': {'1.0'},
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:     'Network': {'1.1'},
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:     'Port': {'1.7'},
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:     'PortForwarding': {'1.2'},
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:     'QosPolicy': {'1.8'},
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:     'SecurityGroup': {'1.4'},
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:     'SecurityGroupRule': {'1.2'},
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:     'SubPort': {'1.0'},
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:     'Subnet': {'1.1'},
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:     'Trunk': {'1.1'}}
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]: consumer versions:
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]: {   DHCP agent@dv-cinder-787262-4-iscsi: {},
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:     L3 agent@dv-cinder-787262-4-iscsi: {},
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:     Metadata agent@dv-cinder-787262-4-iscsi: {},
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:     Metering agent@dv-cinder-787262-4-iscsi: {},
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:     Open vSwitch agent@dv-cinder-787262-4-iscsi: {   'AddressGroup': '1.2',
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'ConntrackHelper': '1.0',
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'Log': '1.0',
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'Network': '1.1',
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'Port': '1.7',
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'PortForwarding': '1.2',
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'QosPolicy': '1.8',
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'SecurityGroup': '1.4',
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'SecurityGroupRule': '1.2',
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'SubPort': '1.0',
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'Subnet': '1.1',
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'Trunk': '1.1'}}
Jun 01 09:58:25.001147 dv-cinder-787262-4-iscsi neutron-server[92566]:  {{(pid=92566) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 09:58:25.045641 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:25.049498 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:58:25.180376 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:25.182046 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 09:58:25.182684 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:25.186065 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:58:25.289221 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Pushing event updated for resources: {'Network': ['ID=afca1f9e-5b29-470b-8bde-2b34d97ce2af,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:58:25.292456 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:58:25.300595 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network afca1f9e-5b29-470b-8bde-2b34d97ce2af details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 09:58:25.374674 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 849 time: 1.2453396
Jun 01 09:58:28.025067 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 55288) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 09:58:28.533893 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87fc228e-de6b-48d8-86f9-8045d0a51b2a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 09:58:28.535203 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-87fc228e-de6b-48d8-86f9-8045d0a51b2a admin admin] 10.222.0.68 "GET /v2.0/networks/afca1f9e-5b29-470b-8bde-2b34d97ce2af HTTP/1.1" status: 200  len: 825 time: 0.5091653
Jun 01 09:58:28.562567 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-3ab3cef9-94d0-43bf-8d83-f1d6ba9aaac8 admin admin] 10.222.0.68 "GET /v2.0/subnetpools/bf0eb258-6597-4108-9e96-08f62e93ab85 HTTP/1.1" status: 200  len: 734 time: 0.0219533
Jun 01 09:58:28.571775 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] Request body: {'subnet': {'ip_version': 4, 'gateway_ip': '172.20.0.1', 'tenant_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'name': 'private-subnet', 'network_id': 'afca1f9e-5b29-470b-8bde-2b34d97ce2af', 'subnetpool_id': 'bf0eb258-6597-4108-9e96-08f62e93ab85'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 09:58:28.575925 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 09:58:28.579616 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] Usage tracker for resource:subnet and tenant:b128dfeba3994ccf96e2a972cb8dea59 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 09:58:28.582562 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 09:58:28.588149 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 09:58:28.661257 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] Made reservation on behalf of b128dfeba3994ccf96e2a972cb8dea59 for: {'subnet': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 09:58:28.663730 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] Notify callbacks [] for subnet, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:29.220520 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303'] for subnet, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:29.226100 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:58:29.307550 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] Pushing event updated for resources: {'Subnet': ['ID=7ff74f8e-bb96-4513-a8ab-dd88209d166b,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:58:29.309582 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] Checking segment: {'id': '8e496b3d-da2d-4b83-9bb7-392d8374523a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'afca1f9e-5b29-470b-8bde-2b34d97ce2af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 09:58:29.309998 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] Network hostable DHCP agents. Network: afca1f9e-5b29-470b-8bde-2b34d97ce2af, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92566) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 09:58:29.314679 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:58:29.382113 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] Network afca1f9e-5b29-470b-8bde-2b34d97ce2af is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92566) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 09:58:29.461398 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, afca1f9e-5b29-470b-8bde-2b34d97ce2af) {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 09:58:29.468945 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 09:58:29.469548 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:29.470803 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3aaf9182-39ec-4150-9f8b-4f9ced946824 None None] Network afca1f9e-5b29-470b-8bde-2b34d97ce2af requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 09:58:29.530649 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 854 time: 0.9626522
Jun 01 09:58:29.785011 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ec86312-457d-532c-ad41-c4edfccc592e-afca1f9e-5b29-470b-8bde-2b34d97ce2af', 'network_id': 'afca1f9e-5b29-470b-8bde-2b34d97ce2af', 'tenant_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'fixed_ips': [{'subnet_id': '7ff74f8e-bb96-4513-a8ab-dd88209d166b'}]}} from dv-cinder-787262-4-iscsi. {{(pid=92567) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 09:58:29.786281 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:29.975476 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.db_base_plugin_common [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Allocated IP 172.20.0.2 (afca1f9e-5b29-470b-8bde-2b34d97ce2af/7ff74f8e-bb96-4513-a8ab-dd88209d166b/ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d) {{(pid=92567) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 09:58:30.206076 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Notify callbacks [] for port, precommit_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:30.219155 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Transition to ACTIVE for port object ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 09:58:30.239729 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Transition to ACTIVE for port object ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d will not be triggered until provisioned by entity DHCP. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 09:58:30.308132 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:30.313175 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:58:30.374428 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Network afca1f9e-5b29-470b-8bde-2b34d97ce2af is already hosted by enough agents. {{(pid=92567) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 09:58:30.377248 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.base_scheduler [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Resources bound (agent type, host, resource id):  {{(pid=92567) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 09:58:30.384444 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Received port after_create {{(pid=92567) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 09:58:30.386547 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Pushing event updated for resources: {'Port': ['ID=ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d,revision_number=1']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:58:30.423231 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:30.423560 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:30.423881 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:30.424196 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:30.424510 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:30.424820 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:30.425125 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:30.425428 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:30.425749 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:30.426055 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:30.426353 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:30.426651 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Tracked resource versions report:
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]: pushed versions:
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]: {   'AddressGroup': {'1.2'},
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:     'ConntrackHelper': {'1.0'},
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:     'Log': {'1.0'},
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:     'Network': {'1.1'},
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:     'Port': {'1.7'},
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:     'PortForwarding': {'1.2'},
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:     'QosPolicy': {'1.8'},
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:     'SecurityGroup': {'1.4'},
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:     'SecurityGroupRule': {'1.2'},
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:     'SubPort': {'1.0'},
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:     'Subnet': {'1.1'},
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:     'Trunk': {'1.1'}}
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]: consumer versions:
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]: {   DHCP agent@dv-cinder-787262-4-iscsi: {},
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:     L3 agent@dv-cinder-787262-4-iscsi: {},
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:     Metadata agent@dv-cinder-787262-4-iscsi: {},
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:     Metering agent@dv-cinder-787262-4-iscsi: {},
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:     Open vSwitch agent@dv-cinder-787262-4-iscsi: {   'AddressGroup': '1.2',
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'ConntrackHelper': '1.0',
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'Log': '1.0',
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'Network': '1.1',
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'Port': '1.7',
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'PortForwarding': '1.2',
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'QosPolicy': '1.8',
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'SecurityGroup': '1.4',
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'SecurityGroupRule': '1.2',
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'SubPort': '1.0',
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'Subnet': '1.1',
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'Trunk': '1.1'}}
Jun 01 09:58:30.427750 dv-cinder-787262-4-iscsi neutron-server[92567]:  {{(pid=92567) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 09:58:30.435430 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:58:30.493391 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Attempting to bind port ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 09:58:30.494012 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Attempting to bind port ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '8e496b3d-da2d-4b83-9bb7-392d8374523a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'afca1f9e-5b29-470b-8bde-2b34d97ce2af'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 09:58:30.494118 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Attempting to bind port ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d on network afca1f9e-5b29-470b-8bde-2b34d97ce2af {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 09:58:30.499328 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 9, 58, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 09:58:30.499734 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Checking segment: {'id': '8e496b3d-da2d-4b83-9bb7-392d8374523a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'afca1f9e-5b29-470b-8bde-2b34d97ce2af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 09:58:30.500200 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:30.500591 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Bound using segment: {'id': '8e496b3d-da2d-4b83-9bb7-392d8374523a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'afca1f9e-5b29-470b-8bde-2b34d97ce2af'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 09:58:30.501178 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Bound port: ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8e496b3d-da2d-4b83-9bb7-392d8374523a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'afca1f9e-5b29-470b-8bde-2b34d97ce2af'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 09:58:30.501513 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:30.591256 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] For port ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 09:58:30.595269 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] For port ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d,segment=NetworkSegment(8e496b3d-da2d-4b83-9bb7-392d8374523a),segment_id=8e496b3d-da2d-4b83-9bb7-392d8374523a)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 09:58:30.651040 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:30.655141 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:58:30.742361 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Pushing event updated for resources: {'Port': ['ID=ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:58:30.748738 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:58:31.909147 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 55298) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 09:58:32.498895 dv-cinder-787262-4-iscsi neutron-server[92565]: WARNING oslo_policy.policy [None req-492cd76d-29aa-4b0d-8714-6e4eefe86169 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 09:58:32.499484 dv-cinder-787262-4-iscsi neutron-server[92565]: WARNING oslo_policy.policy [None req-492cd76d-29aa-4b0d-8714-6e4eefe86169 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 09:58:32.733943 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [None req-492cd76d-29aa-4b0d-8714-6e4eefe86169 admin admin] http://10.222.0.68:9696/v2.0/extensions returned with HTTP 200 {{(pid=92565) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 09:58:32.735191 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-492cd76d-29aa-4b0d-8714-6e4eefe86169 admin admin] 10.222.0.68 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.8239732
Jun 01 09:58:35.112528 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 55316) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 09:58:35.497649 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [None req-a1135979-c104-4bed-9c98-18f86bec4967 admin admin] http://10.222.0.68:9696/v2.0/extensions returned with HTTP 200 {{(pid=92565) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 09:58:35.498609 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-a1135979-c104-4bed-9c98-18f86bec4967 admin admin] 10.222.0.68 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3847756
Jun 01 09:58:36.262560 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b42a8253-8c5d-4322-98c7-d896f537302c None None] Network afca1f9e-5b29-470b-8bde-2b34d97ce2af requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 09:58:36.456133 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-f241782b-f471-4354-9229-9d5668a81bca None None] Provisioning for port ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 09:58:37.053542 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 09:58:37.184700 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 09:58:37.189768 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 09:58:37.190164 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:37.313716 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:37.346129 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d,segment=NetworkSegment(8e496b3d-da2d-4b83-9bb7-392d8374523a),segment_id=8e496b3d-da2d-4b83-9bb7-392d8374523a)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 09:58:37.444279 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:37.446602 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:58:37.515091 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:58:37.518264 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:58:38.145255 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 55328) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 09:58:38.496417 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-ad4c3ee8-bc2d-41fa-b65b-22b926963168 admin admin] Request body: {'router': {'admin_state_up': True, 'name': 'router1', 'tenant_id': 'b128dfeba3994ccf96e2a972cb8dea59'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 09:58:38.566520 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.policy [None req-ad4c3ee8-bc2d-41fa-b65b-22b926963168 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=92565) register_rules /opt/stack/neutron/neutron/policy.py:73}}
Jun 01 09:58:38.611966 dv-cinder-787262-4-iscsi neutron-server[92565]: WARNING oslo_policy.policy [None req-ad4c3ee8-bc2d-41fa-b65b-22b926963168 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 09:58:38.612276 dv-cinder-787262-4-iscsi neutron-server[92565]: WARNING oslo_policy.policy [None req-ad4c3ee8-bc2d-41fa-b65b-22b926963168 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 09:58:38.621921 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.quota [None req-ad4c3ee8-bc2d-41fa-b65b-22b926963168 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7efe732efa00>.
Jun 01 09:58:38.643584 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-ad4c3ee8-bc2d-41fa-b65b-22b926963168 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 09:58:38.650230 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-ad4c3ee8-bc2d-41fa-b65b-22b926963168 admin admin] Usage tracker for resource:router and tenant:b128dfeba3994ccf96e2a972cb8dea59 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 09:58:38.654933 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-ad4c3ee8-bc2d-41fa-b65b-22b926963168 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 09:58:38.662319 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-ad4c3ee8-bc2d-41fa-b65b-22b926963168 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 09:58:38.733790 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ad4c3ee8-bc2d-41fa-b65b-22b926963168 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-405701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15802'] for router, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:38.735905 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ad4c3ee8-bc2d-41fa-b65b-22b926963168 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-407493', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-403482', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-465655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-15793'] for router, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:38.761753 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ad4c3ee8-bc2d-41fa-b65b-22b926963168 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:38.934528 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ad4c3ee8-bc2d-41fa-b65b-22b926963168 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-405708', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-403580'] for router, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:39.013681 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ad4c3ee8-bc2d-41fa-b65b-22b926963168 admin admin] Notify callbacks [] for router, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:39.015589 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-ad4c3ee8-bc2d-41fa-b65b-22b926963168 admin admin] 10.222.0.68 "POST /v2.0/routers HTTP/1.1" status: 201  len: 709 time: 0.8692281
Jun 01 09:58:39.042272 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 09:58:39.116396 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 09:58:39.116772 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:40.484258 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-a06615ec-57c4-4f82-bba0-76669ebaa7d7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:41.329771 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 55340) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 09:58:41.698554 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [None req-66947c67-b316-42f7-bb6a-bfb4b169b627 admin admin] http://10.222.0.68:9696/v2.0/extensions returned with HTTP 200 {{(pid=92566) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 09:58:41.699655 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-66947c67-b316-42f7-bb6a-bfb4b169b627 admin admin] 10.222.0.68 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3688123
Jun 01 09:58:42.941740 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-67c5f4d2-ce06-4df0-a6db-1c34fbe64297 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:43.215996 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:43.929761 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:44.049584 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 55350) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 09:58:44.411785 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Request body: {'network': {'provider:network_type': 'flat', 'router:external': True, 'provider:physical_network': 'physnet1', 'admin_state_up': True, 'is_default': True, 'name': 'public'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 09:58:44.416513 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 09:58:44.420376 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Usage tracker for resource:network and tenant:e2ab804b512c45babfbcdb37975d5c67 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 09:58:44.423773 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 09:58:44.429829 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 09:58:44.478575 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Made reservation on behalf of e2ab804b512c45babfbcdb37975d5c67 for: {'network': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 09:58:44.481431 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:44.498487 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:44.513495 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 09:58:44.517161 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Usage tracker for resource:security_group_rule and tenant:e2ab804b512c45babfbcdb37975d5c67 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 09:58:44.520364 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 09:58:44.525949 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 09:58:44.615129 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:44.681797 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:44.687084 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:58:44.698460 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Reserving flat network on physical network physnet1 {{(pid=92565) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}}
Jun 01 09:58:44.730614 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8726958294501', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:44.731258 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7efe73fc5e50> segment precommit_create {{(pid=92565) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
Jun 01 09:58:44.731735 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.segments_db [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Added segment 4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8 of type flat for network a961b732-0873-4e86-af5a-7e84ae1a2549
Jun 01 09:58:44.781284 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=82b1bbb9-4dee-49fc-b97a-18816e0af274,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:58:44.801017 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:44.801366 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:44.801693 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:44.802013 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:44.802330 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:44.802660 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:44.803618 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:44.803935 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:44.804262 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:44.804575 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:44.804885 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:44.805196 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Tracked resource versions report:
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]: pushed versions:
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]: {   'AddressGroup': {'1.2'},
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:     'ConntrackHelper': {'1.0'},
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:     'Log': {'1.0'},
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:     'Network': {'1.1'},
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:     'Port': {'1.7'},
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:     'PortForwarding': {'1.2'},
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:     'QosPolicy': {'1.8'},
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:     'SecurityGroup': {'1.4'},
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:     'SecurityGroupRule': {'1.2'},
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:     'SubPort': {'1.0'},
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:     'Subnet': {'1.1'},
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:     'Trunk': {'1.1'}}
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]: consumer versions:
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]: {   DHCP agent@dv-cinder-787262-4-iscsi: {},
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:     L3 agent@dv-cinder-787262-4-iscsi: {},
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:     Metadata agent@dv-cinder-787262-4-iscsi: {},
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:     Metering agent@dv-cinder-787262-4-iscsi: {},
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:     Open vSwitch agent@dv-cinder-787262-4-iscsi: {   'AddressGroup': '1.2',
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'ConntrackHelper': '1.0',
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'Log': '1.0',
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'Network': '1.1',
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'Port': '1.7',
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'PortForwarding': '1.2',
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'QosPolicy': '1.8',
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'SecurityGroup': '1.4',
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'SecurityGroupRule': '1.2',
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'SubPort': '1.0',
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'Subnet': '1.1',
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'Trunk': '1.1'}}
Jun 01 09:58:44.806239 dv-cinder-787262-4-iscsi neutron-server[92565]:  {{(pid=92565) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 09:58:44.856888 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:44.860903 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:58:44.969862 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:44.971358 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 09:58:44.971971 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:44.976957 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:58:45.078003 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Pushing event updated for resources: {'Network': ['ID=a961b732-0873-4e86-af5a-7e84ae1a2549,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:58:45.081276 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:58:45.089688 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network a961b732-0873-4e86-af5a-7e84ae1a2549 details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 09:58:45.168383 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 1.1177304
Jun 01 09:58:45.661320 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:47.484015 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 55374) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 09:58:47.689875 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c829a6ca-3497-4747-b93a-a9143d9856e4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 09:58:47.691204 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-c829a6ca-3497-4747-b93a-a9143d9856e4 admin admin] 10.222.0.68 "GET /v2.0/subnets/7ff74f8e-bb96-4513-a8ab-dd88209d166b HTTP/1.1" status: 200  len: 849 time: 0.2062309
Jun 01 09:58:47.871883 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-298c91ab-9466-4c50-85b6-0640126c0d21 admin admin] 10.222.0.68 "GET /v2.0/routers/850ad483-79ef-4445-9037-a81bddb38e45 HTTP/1.1" status: 200  len: 704 time: 0.1745162
Jun 01 09:58:48.329425 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:48.553507 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Allocated IP 172.20.0.1 (afca1f9e-5b29-470b-8bde-2b34d97ce2af/7ff74f8e-bb96-4513-a8ab-dd88209d166b/8ac7f70c-0409-41fa-99a1-bd0571181928) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 09:58:48.736581 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:48.754306 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Transition to ACTIVE for port object 8ac7f70c-0409-41fa-99a1-bd0571181928 will not be triggered until provisioned by entity DHCP. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 09:58:48.871655 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:48.875419 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:58:48.936273 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Network afca1f9e-5b29-470b-8bde-2b34d97ce2af is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 09:58:48.939146 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 09:58:48.942465 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 09:58:48.942990 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-401677'] for router_interface, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:49.060328 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Pushing event updated for resources: {'Port': ['ID=8ac7f70c-0409-41fa-99a1-bd0571181928,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:58:49.075259 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:58:49.198245 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-b71e46ec-5ab9-42ea-93cb-20eae5b4f4bc None None] Provisioning for port 8ac7f70c-0409-41fa-99a1-bd0571181928 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 09:58:49.203208 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-b71e46ec-5ab9-42ea-93cb-20eae5b4f4bc None None] Provisioning complete for port 8ac7f70c-0409-41fa-99a1-bd0571181928 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 09:58:49.203580 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b71e46ec-5ab9-42ea-93cb-20eae5b4f4bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:49.255195 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-b71e46ec-5ab9-42ea-93cb-20eae5b4f4bc None None] Port 8ac7f70c-0409-41fa-99a1-bd0571181928 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 09:58:49.290185 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:49.512661 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:49.564033 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:49.565150 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7873030', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-401824'] for router_interface, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:49.568542 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:58:49.695851 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Pushing event updated for resources: {'Port': ['ID=8ac7f70c-0409-41fa-99a1-bd0571181928,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:58:49.700094 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:58:49.758183 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Network afca1f9e-5b29-470b-8bde-2b34d97ce2af is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 09:58:49.759263 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 09:58:49.978005 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-0e0227fb-d554-4683-9fc0-d788afc60fda None None] Provisioning complete for port 8ac7f70c-0409-41fa-99a1-bd0571181928 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 09:58:49.978370 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-0e0227fb-d554-4683-9fc0-d788afc60fda None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:50.015968 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Router 850ad483-79ef-4445-9037-a81bddb38e45 is scheduled to L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c with binding_index 1 {{(pid=92566) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 09:58:50.035224 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-0e0227fb-d554-4683-9fc0-d788afc60fda None None] Port 8ac7f70c-0409-41fa-99a1-bd0571181928 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 09:58:50.168222 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 09:58:50.177136 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] 10.222.0.68 "PUT /v2.0/routers/850ad483-79ef-4445-9037-a81bddb38e45/add_router_interface HTTP/1.1" status: 200  len: 508 time: 2.3005824
Jun 01 09:58:50.177941 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Sync routers for ids ['850ad483-79ef-4445-9037-a81bddb38e45'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 09:58:50.188328 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Routers {'850ad483-79ef-4445-9037-a81bddb38e45'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 09:58:50.189158 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe734cdaf0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T09:58:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['850ad483-79ef-4445-9037-a81bddb38e45'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 09:58:50.361808 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Set router 850ad483-79ef-4445-9037-a81bddb38e45 gateway port host: None {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 09:58:50.728261 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe734cdaf0>, [{'id': '850ad483-79ef-4445-9037-a81bddb38e45', 'name': 'router1', 'tenant_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T09:58:38Z', 'updated_at': '2021-06-01T09:58:49Z', 'revision_number': 2, 'project_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'gw_port_host': None, '_interfaces': [{'id': '8ac7f70c-0409-41fa-99a1-bd0571181928', 'name': '', 'network_id': 'afca1f9e-5b29-470b-8bde-2b34d97ce2af', 'tenant_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'mac_address': 'fa:16:3e:22:76:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '850ad483-79ef-4445-9037-a81bddb38e45', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '7ff74f8e-bb96-4513-a8ab-dd88209d166b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T09:58:48Z', 'updated_at': '2021-06-01T09:58:49Z', 'revision_number': 2, 'project_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'subnets': [{'id': '7ff74f8e-bb96-4513-a8ab-dd88209d166b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bf0eb258-6597-4108-9e96-08f62e93ab85'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 09:58:50.733123 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Checking router: 850ad483-79ef-4445-9037-a81bddb38e45 for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 09:58:50.733490 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Updating router 850ad483-79ef-4445-9037-a81bddb38e45 port 8ac7f70c-0409-41fa-99a1-bd0571181928 binding host dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 09:58:50.788248 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:51.159952 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Notify callbacks [] for port, precommit_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:51.175226 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.provisioning_blocks [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Transition to ACTIVE for port object 8ac7f70c-0409-41fa-99a1-bd0571181928 will not be triggered until provisioned by entity L2. {{(pid=92568) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 09:58:51.244362 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:51.250099 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:58:51.440701 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Pushing event updated for resources: {'Port': ['ID=8ac7f70c-0409-41fa-99a1-bd0571181928,revision_number=3']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:58:51.468526 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:51.468864 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:51.469191 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:51.469511 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:51.469827 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:51.470141 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:51.470451 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:51.470765 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:51.471105 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:51.471413 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:51.471720 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:51.472028 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Tracked resource versions report:
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]: pushed versions:
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]: {   'AddressGroup': {'1.2'},
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:     'ConntrackHelper': {'1.0'},
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:     'Log': {'1.0'},
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:     'Network': {'1.1'},
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:     'Port': {'1.7'},
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:     'PortForwarding': {'1.2'},
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:     'QosPolicy': {'1.8'},
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:     'SecurityGroup': {'1.4'},
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:     'SecurityGroupRule': {'1.2'},
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:     'SubPort': {'1.0'},
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:     'Subnet': {'1.1'},
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:     'Trunk': {'1.1'}}
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]: consumer versions:
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]: {   DHCP agent@dv-cinder-787262-4-iscsi: {},
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:     L3 agent@dv-cinder-787262-4-iscsi: {},
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:     Metadata agent@dv-cinder-787262-4-iscsi: {},
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:     Metering agent@dv-cinder-787262-4-iscsi: {},
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:     Open vSwitch agent@dv-cinder-787262-4-iscsi: {   'AddressGroup': '1.2',
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'ConntrackHelper': '1.0',
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'Log': '1.0',
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'Network': '1.1',
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'Port': '1.7',
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'PortForwarding': '1.2',
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'QosPolicy': '1.8',
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'SecurityGroup': '1.4',
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'SecurityGroupRule': '1.2',
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'SubPort': '1.0',
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'Subnet': '1.1',
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'Trunk': '1.1'}}
Jun 01 09:58:51.473099 dv-cinder-787262-4-iscsi neutron-server[92568]:  {{(pid=92568) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 09:58:51.481656 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Attempting to bind port 8ac7f70c-0409-41fa-99a1-bd0571181928 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 09:58:51.482043 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Attempting to bind port 8ac7f70c-0409-41fa-99a1-bd0571181928 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '8e496b3d-da2d-4b83-9bb7-392d8374523a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'afca1f9e-5b29-470b-8bde-2b34d97ce2af'}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 09:58:51.482477 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Attempting to bind port 8ac7f70c-0409-41fa-99a1-bd0571181928 on network afca1f9e-5b29-470b-8bde-2b34d97ce2af {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 09:58:51.485842 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.236s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:58:51.488475 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 9, 58, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 09:58:51.488882 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Checking segment: {'id': '8e496b3d-da2d-4b83-9bb7-392d8374523a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'afca1f9e-5b29-470b-8bde-2b34d97ce2af'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92568) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 09:58:51.489350 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:51.489730 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Bound using segment: {'id': '8e496b3d-da2d-4b83-9bb7-392d8374523a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'afca1f9e-5b29-470b-8bde-2b34d97ce2af'} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 09:58:51.490261 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Bound port: 8ac7f70c-0409-41fa-99a1-bd0571181928, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8e496b3d-da2d-4b83-9bb7-392d8374523a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'afca1f9e-5b29-470b-8bde-2b34d97ce2af'}}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 09:58:51.490679 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:51.577392 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] For port 8ac7f70c-0409-41fa-99a1-bd0571181928, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92568) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 09:58:51.581352 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] For port 8ac7f70c-0409-41fa-99a1-bd0571181928, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=8ac7f70c-0409-41fa-99a1-bd0571181928,segment=NetworkSegment(8e496b3d-da2d-4b83-9bb7-392d8374523a),segment_id=8e496b3d-da2d-4b83-9bb7-392d8374523a)] {{(pid=92568) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 09:58:51.633169 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:51.637998 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:58:51.709923 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Routers {'850ad483-79ef-4445-9037-a81bddb38e45'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 09:58:51.710552 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe734cdaf0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T09:58:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['850ad483-79ef-4445-9037-a81bddb38e45'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 09:58:51.877962 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Pushing event updated for resources: {'Port': ['ID=8ac7f70c-0409-41fa-99a1-bd0571181928,revision_number=4']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:58:51.883715 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.246s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:58:51.906159 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] Set router 850ad483-79ef-4445-9037-a81bddb38e45 gateway port host: None {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 09:58:52.236428 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe734cdaf0>, [{'id': '850ad483-79ef-4445-9037-a81bddb38e45', 'name': 'router1', 'tenant_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T09:58:38Z', 'updated_at': '2021-06-01T09:58:49Z', 'revision_number': 2, 'project_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'gw_port_host': None, '_interfaces': [{'id': '8ac7f70c-0409-41fa-99a1-bd0571181928', 'name': '', 'network_id': 'afca1f9e-5b29-470b-8bde-2b34d97ce2af', 'tenant_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'mac_address': 'fa:16:3e:22:76:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '850ad483-79ef-4445-9037-a81bddb38e45', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '7ff74f8e-bb96-4513-a8ab-dd88209d166b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T09:58:48Z', 'updated_at': '2021-06-01T09:58:51Z', 'revision_number': 4, 'project_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'subnets': [{'id': '7ff74f8e-bb96-4513-a8ab-dd88209d166b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bf0eb258-6597-4108-9e96-08f62e93ab85'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 09:58:52.241697 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3dee60f4-f993-41b4-9490-eca5657549dd None None] The sync data for ids ['850ad483-79ef-4445-9037-a81bddb38e45'] in dv-cinder-787262-4-iscsi is: [{'id': '850ad483-79ef-4445-9037-a81bddb38e45', 'name': 'router1', 'tenant_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T09:58:38Z', 'updated_at': '2021-06-01T09:58:49Z', 'revision_number': 2, 'project_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'gw_port_host': None, '_interfaces': [{'id': '8ac7f70c-0409-41fa-99a1-bd0571181928', 'name': '', 'network_id': 'afca1f9e-5b29-470b-8bde-2b34d97ce2af', 'tenant_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'mac_address': 'fa:16:3e:22:76:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '850ad483-79ef-4445-9037-a81bddb38e45', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '7ff74f8e-bb96-4513-a8ab-dd88209d166b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T09:58:48Z', 'updated_at': '2021-06-01T09:58:51Z', 'revision_number': 4, 'project_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'subnets': [{'id': '7ff74f8e-bb96-4513-a8ab-dd88209d166b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bf0eb258-6597-4108-9e96-08f62e93ab85'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 09:58:52.339916 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 55396) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 09:58:52.471725 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 5 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 09:58:52.528840 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0bccdc95-01ee-415f-8115-55883dfde4ab admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 09:58:52.530382 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-0bccdc95-01ee-415f-8115-55883dfde4ab admin admin] 10.222.0.68 "GET /v2.0/networks/a961b732-0873-4e86-af5a-7e84ae1a2549 HTTP/1.1" status: 200  len: 842 time: 0.1891673
Jun 01 09:58:52.540262 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Request body: {'subnet': {'name': 'public-subnet', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'cidr': '172.27.2.0/24', 'ip_version': 4, 'enable_dhcp': False, 'gateway_ip': '172.27.2.1'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 09:58:52.545570 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 09:58:52.549329 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Usage tracker for resource:subnet and tenant:e2ab804b512c45babfbcdb37975d5c67 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 09:58:52.552150 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 09:58:52.558419 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 09:58:52.655455 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Made reservation on behalf of e2ab804b512c45babfbcdb37975d5c67 for: {'subnet': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 09:58:52.657757 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Notify callbacks [] for subnet, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:53.192134 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.objects.ports [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=92566) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}}
Jun 01 09:58:53.192569 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303'] for subnet, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:53.197451 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:58:53.265333 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Pushing event updated for resources: {'Subnet': ['ID=0acb7e18-8599-43e3-af85-b85c21da308c,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:58:53.268556 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:58:53.274747 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Checking segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 09:58:53.275129 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Network hostable DHCP agents. Network: a961b732-0873-4e86-af5a-7e84ae1a2549, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92566) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 09:58:53.367924 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92566) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 09:58:53.445332 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, a961b732-0873-4e86-af5a-7e84ae1a2549) {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 09:58:53.449474 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 09:58:53.450059 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:53.457290 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9e0bac0-e80f-4d1a-9650-3e4d13e7b31b None None] Network a961b732-0873-4e86-af5a-7e84ae1a2549 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 09:58:53.550949 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 821 time: 1.0009966
Jun 01 09:58:53.666918 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4941486-4aec-42e5-8c89-ca056ba6ae9f None None] Network a961b732-0873-4e86-af5a-7e84ae1a2549 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 09:58:55.071833 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 8ac7f70c-0409-41fa-99a1-bd0571181928 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 09:58:55.227085 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 8ac7f70c-0409-41fa-99a1-bd0571181928 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 09:58:55.232628 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 8ac7f70c-0409-41fa-99a1-bd0571181928 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 09:58:55.233004 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:55.356050 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:55.390370 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 8ac7f70c-0409-41fa-99a1-bd0571181928, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=8ac7f70c-0409-41fa-99a1-bd0571181928,segment=NetworkSegment(8e496b3d-da2d-4b83-9bb7-392d8374523a),segment_id=8e496b3d-da2d-4b83-9bb7-392d8374523a)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 09:58:55.472909 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:55.475036 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:58:55.545024 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=8ac7f70c-0409-41fa-99a1-bd0571181928,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:58:55.548062 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:58:55.749612 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 55410) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 09:58:55.948241 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-799fe7ac-4624-4222-b039-ab84de8fbf6e admin admin] 10.222.0.68 "GET /v2.0/routers/850ad483-79ef-4445-9037-a81bddb38e45 HTTP/1.1" status: 200  len: 710 time: 0.1969986
Jun 01 09:58:56.073351 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d2a17e6f-db56-4f61-87c3-8431bab1b5d2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 09:58:56.074838 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-d2a17e6f-db56-4f61-87c3-8431bab1b5d2 admin admin] 10.222.0.68 "GET /v2.0/networks/a961b732-0873-4e86-af5a-7e84ae1a2549 HTTP/1.1" status: 200  len: 886 time: 0.1220183
Jun 01 09:58:56.083504 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 09:58:56.561012 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-403519', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-405751', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-15815'] for router, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:56.933208 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:56.987303 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:57.048648 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 8ac7f70c-0409-41fa-99a1-bd0571181928 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 09:58:57.116125 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 8ac7f70c-0409-41fa-99a1-bd0571181928 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 09:58:57.116500 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:57.125495 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Allocated IP 172.27.2.84 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/0492a87b-60b2-415d-9e83-23c9453b37b6) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 09:58:57.268392 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:57.353035 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:57.357040 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:58:57.416854 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 09:58:57.419643 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 09:58:57.423388 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 09:58:57.492510 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Pushing event updated for resources: {'Port': ['ID=0492a87b-60b2-415d-9e83-23c9453b37b6,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:58:57.540025 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:58:57.867997 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:58.252424 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-403519', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-405751', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-15815'] for router, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:58.255725 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-403580', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-403508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-403573', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-405729'] for router, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:58.433860 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Router 850ad483-79ef-4445-9037-a81bddb38e45 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92566) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 09:58:58.614207 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 09:58:58.623417 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Notify callbacks [] for router, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:58.623633 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Sync routers for ids ['850ad483-79ef-4445-9037-a81bddb38e45'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 09:58:58.624612 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] 10.222.0.68 "PUT /v2.0/routers/850ad483-79ef-4445-9037-a81bddb38e45 HTTP/1.1" status: 200  len: 889 time: 2.5443418
Jun 01 09:58:58.634008 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Routers {'850ad483-79ef-4445-9037-a81bddb38e45'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 09:58:58.634650 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe734fda90>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T09:58:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['850ad483-79ef-4445-9037-a81bddb38e45'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 09:58:58.827507 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Set router 850ad483-79ef-4445-9037-a81bddb38e45 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 09:58:59.187772 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe734fda90>, [{'id': '850ad483-79ef-4445-9037-a81bddb38e45', 'name': 'router1', 'tenant_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.84'}], 'enable_snat': True}, 'gw_port_id': '0492a87b-60b2-415d-9e83-23c9453b37b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T09:58:38Z', 'updated_at': '2021-06-01T09:58:57Z', 'revision_number': 4, 'project_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'gw_port': {'id': '0492a87b-60b2-415d-9e83-23c9453b37b6', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:ee:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '850ad483-79ef-4445-9037-a81bddb38e45', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T09:58:57Z', 'updated_at': '2021-06-01T09:58:57Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '8ac7f70c-0409-41fa-99a1-bd0571181928', 'name': '', 'network_id': 'afca1f9e-5b29-470b-8bde-2b34d97ce2af', 'tenant_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'mac_address': 'fa:16:3e:22:76:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '850ad483-79ef-4445-9037-a81bddb38e45', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '7ff74f8e-bb96-4513-a8ab-dd88209d166b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T09:58:48Z', 'updated_at': '2021-06-01T09:58:55Z', 'revision_number': 5, 'project_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'subnets': [{'id': '7ff74f8e-bb96-4513-a8ab-dd88209d166b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bf0eb258-6597-4108-9e96-08f62e93ab85'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 09:58:59.192775 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Checking router: 850ad483-79ef-4445-9037-a81bddb38e45 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 09:58:59.193134 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Updating router 850ad483-79ef-4445-9037-a81bddb38e45 port 0492a87b-60b2-415d-9e83-23c9453b37b6 binding host dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 09:58:59.245031 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:59.595714 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Notify callbacks [] for port, precommit_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:59.607243 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Transition to ACTIVE for port object 0492a87b-60b2-415d-9e83-23c9453b37b6 will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 09:58:59.666771 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:59.671727 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:58:59.750606 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Attempting to bind port 0492a87b-60b2-415d-9e83-23c9453b37b6 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 09:58:59.750997 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Attempting to bind port 0492a87b-60b2-415d-9e83-23c9453b37b6 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 09:58:59.751405 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Attempting to bind port 0492a87b-60b2-415d-9e83-23c9453b37b6 on network a961b732-0873-4e86-af5a-7e84ae1a2549 {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 09:58:59.760741 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 9, 58, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 09:58:59.761110 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Checking segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 09:58:59.761507 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:59.761897 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Bound using segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 09:58:59.762367 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Bound port: 0492a87b-60b2-415d-9e83-23c9453b37b6, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 09:58:59.762730 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:59.785822 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e1a11c3-a89e-42ac-a23e-543c6ffb5df9 None None] Pushing event updated for resources: {'Port': ['ID=0492a87b-60b2-415d-9e83-23c9453b37b6,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:58:59.792870 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-5e1a11c3-a89e-42ac-a23e-543c6ffb5df9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:58:59.837394 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] For port 0492a87b-60b2-415d-9e83-23c9453b37b6, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 09:58:59.840372 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] For port 0492a87b-60b2-415d-9e83-23c9453b37b6, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=0492a87b-60b2-415d-9e83-23c9453b37b6,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 09:58:59.907368 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:58:59.911203 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:58:59.989554 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Routers {'850ad483-79ef-4445-9037-a81bddb38e45'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 09:58:59.990196 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe734fda90>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T09:58:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['850ad483-79ef-4445-9037-a81bddb38e45'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 09:59:00.041786 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e1a11c3-a89e-42ac-a23e-543c6ffb5df9 None None] Pushing event updated for resources: {'Port': ['ID=0492a87b-60b2-415d-9e83-23c9453b37b6,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:59:00.052410 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-5e1a11c3-a89e-42ac-a23e-543c6ffb5df9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:59:00.176527 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] Set router 850ad483-79ef-4445-9037-a81bddb38e45 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 09:59:00.503459 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe734fda90>, [{'id': '850ad483-79ef-4445-9037-a81bddb38e45', 'name': 'router1', 'tenant_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.84'}], 'enable_snat': True}, 'gw_port_id': '0492a87b-60b2-415d-9e83-23c9453b37b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T09:58:38Z', 'updated_at': '2021-06-01T09:58:57Z', 'revision_number': 4, 'project_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'gw_port': {'id': '0492a87b-60b2-415d-9e83-23c9453b37b6', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:ee:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '850ad483-79ef-4445-9037-a81bddb38e45', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T09:58:57Z', 'updated_at': '2021-06-01T09:58:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '8ac7f70c-0409-41fa-99a1-bd0571181928', 'name': '', 'network_id': 'afca1f9e-5b29-470b-8bde-2b34d97ce2af', 'tenant_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'mac_address': 'fa:16:3e:22:76:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '850ad483-79ef-4445-9037-a81bddb38e45', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '7ff74f8e-bb96-4513-a8ab-dd88209d166b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T09:58:48Z', 'updated_at': '2021-06-01T09:58:55Z', 'revision_number': 5, 'project_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'subnets': [{'id': '7ff74f8e-bb96-4513-a8ab-dd88209d166b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bf0eb258-6597-4108-9e96-08f62e93ab85'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 09:59:00.507593 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbead2bf-e0a5-4651-9924-5c944583edaa None None] The sync data for ids ['850ad483-79ef-4445-9037-a81bddb38e45'] in dv-cinder-787262-4-iscsi is: [{'id': '850ad483-79ef-4445-9037-a81bddb38e45', 'name': 'router1', 'tenant_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.84'}], 'enable_snat': True}, 'gw_port_id': '0492a87b-60b2-415d-9e83-23c9453b37b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T09:58:38Z', 'updated_at': '2021-06-01T09:58:57Z', 'revision_number': 4, 'project_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'gw_port': {'id': '0492a87b-60b2-415d-9e83-23c9453b37b6', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:ee:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '850ad483-79ef-4445-9037-a81bddb38e45', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T09:58:57Z', 'updated_at': '2021-06-01T09:58:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '8ac7f70c-0409-41fa-99a1-bd0571181928', 'name': '', 'network_id': 'afca1f9e-5b29-470b-8bde-2b34d97ce2af', 'tenant_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'mac_address': 'fa:16:3e:22:76:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '850ad483-79ef-4445-9037-a81bddb38e45', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '7ff74f8e-bb96-4513-a8ab-dd88209d166b', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T09:58:48Z', 'updated_at': '2021-06-01T09:58:55Z', 'revision_number': 5, 'project_id': 'b128dfeba3994ccf96e2a972cb8dea59', 'subnets': [{'id': '7ff74f8e-bb96-4513-a8ab-dd88209d166b', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bf0eb258-6597-4108-9e96-08f62e93ab85'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 09:59:00.963559 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 55420) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 09:59:01.076213 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 0492a87b-60b2-415d-9e83-23c9453b37b6 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 09:59:01.088486 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-904054a3-3b8e-4579-8975-69df4319065e admin admin] 10.222.0.68 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200  len: 410 time: 0.1237910
Jun 01 09:59:01.254176 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 0492a87b-60b2-415d-9e83-23c9453b37b6 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 09:59:01.260072 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 0492a87b-60b2-415d-9e83-23c9453b37b6 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 09:59:01.264969 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:59:01.378725 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:59:01.495133 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 0492a87b-60b2-415d-9e83-23c9453b37b6, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=0492a87b-60b2-415d-9e83-23c9453b37b6,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 09:59:01.558605 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:59:01.560738 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 09:59:01.628857 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=0492a87b-60b2-415d-9e83-23c9453b37b6,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 09:59:01.632653 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 09:59:03.054023 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 0492a87b-60b2-415d-9e83-23c9453b37b6 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 09:59:03.134559 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 0492a87b-60b2-415d-9e83-23c9453b37b6 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 09:59:03.134968 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:59:10.439169 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8fe064f0-b1ca-4f02-9734-adf5c6e7d831 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:59:12.919475 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-bfe07714-15c1-4721-b6d2-ef64b0d9667f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:59:13.244387 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:59:13.947258 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:59:15.713735 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:59:29.473210 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 5 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 09:59:40.443892 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-164f8eb4-a6c5-4c0d-8efe-139f5411c253 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:59:42.929787 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b6ee6b9a-5962-498e-9a2e-6d9af04bbfca None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:59:43.243829 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:59:44.220245 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 09:59:45.693968 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:00:06.473601 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 5 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:00:10.461443 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-f234e9b3-8546-422b-88ad-824bb4ec7ed1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:00:12.927690 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-0c512168-5a36-4c36-aaa0-b9e8c670421d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:00:13.218817 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:00:13.950811 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:00:15.695440 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:00:37.824203 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 55990) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:00:37.890513 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.pecan_wsgi.hooks.translation [None req-45e9bebf-ee17-412c-8935-4605c831a99b admin admin] GET failed (client error): The resource could not be found.
Jun 01 10:00:37.891813 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-45e9bebf-ee17-412c-8935-4605c831a99b admin admin] 10.222.0.68 "GET /v2.0/networks/private HTTP/1.1" status: 404  len: 315 time: 0.0666249
Jun 01 10:00:38.020073 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-103ede95-47e9-462b-a3eb-b883b7f884b2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:00:38.021692 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-103ede95-47e9-462b-a3eb-b883b7f884b2 admin admin] 10.222.0.68 "GET /v2.0/networks?name=private HTTP/1.1" status: 200  len: 872 time: 0.1261411
Jun 01 10:00:40.112395 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56000) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:00:40.221679 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e97cd444-bb55-4f79-8597-35ac1bbbea96 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:00:40.222244 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-e97cd444-bb55-4f79-8597-35ac1bbbea96 admin admin] Synchronizing usage tracker for tenant:e2ab804b512c45babfbcdb37975d5c67 on resource:subnet {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:00:40.378994 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-e97cd444-bb55-4f79-8597-35ac1bbbea96 admin admin] Unset dirty status for tenant:e2ab804b512c45babfbcdb37975d5c67 on resource:subnet {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:00:40.380081 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-e97cd444-bb55-4f79-8597-35ac1bbbea96 admin admin] 10.222.0.68 "GET /v2.0/subnets/7ff74f8e-bb96-4513-a8ab-dd88209d166b HTTP/1.1" status: 200  len: 849 time: 0.2664557
Jun 01 10:00:40.389397 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:00:40.426395 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-561572bf-d5b8-4ccd-99eb-3ace85d447d4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:00:40.505063 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Notify callbacks [] for subnet, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:00:40.757679 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8726958284445'] for subnet, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:00:40.761745 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-0fdb90c9-c1e9-4169-87be-65d0e70f266c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:00:40.802049 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:00:40.802645 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:00:40.804119 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] 10.222.0.68 "PUT /v2.0/subnets/7ff74f8e-bb96-4513-a8ab-dd88209d166b HTTP/1.1" status: 200  len: 868 time: 0.4185672
Jun 01 10:00:40.807975 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5551286b-ba7b-433e-a6da-5e7c6438816f None None] Network afca1f9e-5b29-470b-8bde-2b34d97ce2af requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:00:40.829809 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7ff74f8e-bb96-4513-a8ab-dd88209d166b,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:00:40.838173 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:00:40.838543 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:00:40.838887 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:00:40.839345 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:00:40.839681 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:00:40.840031 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:00:40.840365 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:00:40.840689 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:00:40.841033 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:00:40.841364 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:00:40.841685 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:00:40.842003 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:00:40.851235 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-03dff3bd-76fe-4f3f-8405-3dbbaf071680 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:00:41.232798 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-76cc96a4-4db3-42f3-9e48-996879503402 None None] Provisioning complete for port ac9a679c-65df-4f00-bfe1-dfc7fe28fe6d triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:00:41.233171 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-76cc96a4-4db3-42f3-9e48-996879503402 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:00:41.360308 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-76cc96a4-4db3-42f3-9e48-996879503402 None None] Provisioning complete for port 8ac7f70c-0409-41fa-99a1-bd0571181928 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:00:41.360567 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-76cc96a4-4db3-42f3-9e48-996879503402 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:00:42.935376 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-d162a2ac-107a-4494-9fdc-7bb54f5d1fef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:00:43.013190 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56010) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:00:43.196274 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83bbda2b-8fff-41e1-9d76-3561991da90b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:00:43.196808 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83bbda2b-8fff-41e1-9d76-3561991da90b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:00:43.197553 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-83bbda2b-8fff-41e1-9d76-3561991da90b admin admin] Synchronizing usage tracker for tenant:e2ab804b512c45babfbcdb37975d5c67 on resource:network {{(pid=92565) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:00:43.247553 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:00:43.306757 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-83bbda2b-8fff-41e1-9d76-3561991da90b admin admin] Unset dirty status for tenant:e2ab804b512c45babfbcdb37975d5c67 on resource:network {{(pid=92565) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:00:43.307924 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-83bbda2b-8fff-41e1-9d76-3561991da90b admin admin] 10.222.0.68 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.2938433
Jun 01 10:00:43.475153 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 5 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:00:43.944412 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:00:45.405614 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56020) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:00:45.595742 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4479f29e-db2e-44a8-a64a-5a877125692f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:00:45.596136 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4479f29e-db2e-44a8-a64a-5a877125692f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:00:45.597671 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-4479f29e-db2e-44a8-a64a-5a877125692f admin admin] 10.222.0.68 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1909378
Jun 01 10:00:45.712419 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:00:47.723278 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56030) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:00:47.935824 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-758490bb-7c73-4f2e-ba5b-ce443257b4ed admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:00:47.937215 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-758490bb-7c73-4f2e-ba5b-ce443257b4ed admin admin] 10.222.0.68 "GET /v2.0/networks/a961b732-0873-4e86-af5a-7e84ae1a2549 HTTP/1.1" status: 200  len: 886 time: 0.2129655
Jun 01 10:00:50.045903 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56040) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:00:50.248759 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0df2c257-f502-4119-b400-617615750487 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:00:50.250151 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-0df2c257-f502-4119-b400-617615750487 admin admin] 10.222.0.68 "GET /v2.0/networks/afca1f9e-5b29-470b-8bde-2b34d97ce2af HTTP/1.1" status: 200  len: 869 time: 0.2033098
Jun 01 10:00:52.350281 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56050) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:00:52.455839 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7b2f6e8-410c-417a-80de-c7d4685faa1b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:00:52.456301 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7b2f6e8-410c-417a-80de-c7d4685faa1b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:00:52.457832 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-f7b2f6e8-410c-417a-80de-c7d4685faa1b admin admin] 10.222.0.68 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1065981
Jun 01 10:00:54.585108 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56060) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:00:54.694673 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e78f5d1-e7f3-4897-9c18-f7a468e1b78d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:00:54.695171 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e78f5d1-e7f3-4897-9c18-f7a468e1b78d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:00:54.696707 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-8e78f5d1-e7f3-4897-9c18-f7a468e1b78d admin admin] 10.222.0.68 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1106110
Jun 01 10:00:56.781773 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56070) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:00:56.882210 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd13cf6e-d15a-4df7-a152-1d68514ce921 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:00:56.883583 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-fd13cf6e-d15a-4df7-a152-1d68514ce921 admin admin] 10.222.0.68 "GET /v2.0/subnets/0acb7e18-8599-43e3-af85-b85c21da308c HTTP/1.1" status: 200  len: 816 time: 0.1008890
Jun 01 10:00:58.982717 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56080) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:00:59.091225 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b6f24b7-6e89-4b32-b108-aa4a6c30f536 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:00:59.092583 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-3b6f24b7-6e89-4b32-b108-aa4a6c30f536 admin admin] 10.222.0.68 "GET /v2.0/subnets/7ff74f8e-bb96-4513-a8ab-dd88209d166b HTTP/1.1" status: 200  len: 868 time: 0.1088805
Jun 01 10:01:10.437820 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-d3a4bc04-19c3-44ed-ab62-333e7a0f2642 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:12.917786 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-40a2722d-0b9e-4297-b4fe-0f0f6ecb7e93 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:13.226618 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:13.961344 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:15.710868 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:20.474204 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 5 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:01:22.136883 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56124) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:01:22.184120 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [None req-9e34a183-b383-4417-94fc-b515d7698edb admin admin] http://10.222.0.68:9696/v2.0/extensions returned with HTTP 200 {{(pid=92565) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 10:01:22.185138 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-9e34a183-b383-4417-94fc-b515d7698edb admin admin] 10.222.0.68 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0472906
Jun 01 10:01:24.379809 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56134) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:01:24.446604 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.pecan_wsgi.hooks.translation [None req-4bebaec4-5268-46c7-aa64-486869f1666e admin admin] GET failed (client error): The resource could not be found.
Jun 01 10:01:24.447874 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-4bebaec4-5268-46c7-aa64-486869f1666e admin admin] 10.222.0.68 "GET /v2.0/networks/public HTTP/1.1" status: 404  len: 314 time: 0.0671546
Jun 01 10:01:24.572133 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a6bee60-6952-4fac-866b-80c619be2057 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:01:24.573523 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-6a6bee60-6952-4fac-866b-80c619be2057 admin admin] 10.222.0.68 "GET /v2.0/networks?name=public HTTP/1.1" status: 200  len: 889 time: 0.1217964
Jun 01 10:01:26.691829 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56144) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:01:26.740096 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Request body: {'network': {'name': 'shared', 'shared': True, 'admin_state_up': True}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:01:26.744550 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:01:26.753897 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:01:26.826214 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Made reservation on behalf of e2ab804b512c45babfbcdb37975d5c67 for: {'network': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:01:26.828553 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:26.915948 dv-cinder-787262-4-iscsi neutron-server[92565]: WARNING neutron.services.revisions.revision_plugin [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Could not find related network for resource <neutron.db.rbac_db_models.NetworkRBAC[object at 7efe733107f0] {project_id='e2ab804b512c45babfbcdb37975d5c67', id='cf855f7f-4a7d-41d4-ac57-8e63ca532f8e', target_tenant='*', action='access_as_shared', object_id='c0c2a0bb-c319-4af9-971a-32b17b1a0361'}> to bump revision.
Jun 01 10:01:26.928195 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 852}  {{(pid=92565) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:01:26.939099 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:26.939439 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.segments_db [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Added segment 23fb1f68-b8b8-40f2-b730-865b14c5c5f3 of type vlan for network c0c2a0bb-c319-4af9-971a-32b17b1a0361
Jun 01 10:01:26.968966 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:27.049054 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:27.050348 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:01:27.050994 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:27.056089 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:01:27.157007 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Pushing event updated for resources: {'Network': ['ID=c0c2a0bb-c319-4af9-971a-32b17b1a0361,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:01:27.163774 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:27.164133 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:27.164471 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:27.164800 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:27.165126 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:27.165469 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:27.165793 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:27.166179 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:27.166446 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:27.166767 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:27.167185 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:27.167506 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:27.170868 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:01:27.178544 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network c0c2a0bb-c319-4af9-971a-32b17b1a0361 details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:01:27.224865 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.5319586
Jun 01 10:01:29.387081 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56154) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:01:29.454269 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.pecan_wsgi.hooks.translation [None req-06b0bfea-da54-45fa-b385-849644b005af admin admin] GET failed (client error): The resource could not be found.
Jun 01 10:01:29.454824 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-06b0bfea-da54-45fa-b385-849644b005af admin admin] Synchronizing usage tracker for tenant:e2ab804b512c45babfbcdb37975d5c67 on resource:network {{(pid=92565) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:01:29.532375 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-06b0bfea-da54-45fa-b385-849644b005af admin admin] Unset dirty status for tenant:e2ab804b512c45babfbcdb37975d5c67 on resource:network {{(pid=92565) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:01:29.533603 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-06b0bfea-da54-45fa-b385-849644b005af admin admin] 10.222.0.68 "GET /v2.0/networks/shared HTTP/1.1" status: 404  len: 314 time: 0.1456575
Jun 01 10:01:29.641950 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0eeaf224-f757-4f8b-b69f-88d5a23a9124 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:01:29.643362 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-0eeaf224-f757-4f8b-b69f-88d5a23a9124 admin admin] 10.222.0.68 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200  len: 826 time: 0.1051786
Jun 01 10:01:29.653507 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-632f7113-4e42-4d5f-b991-ad997f2ac37d admin admin] Request body: {'subnet': {'ip_version': 4, 'cidr': '192.168.233.0/24', 'name': 'shared-subnet', 'network_id': 'c0c2a0bb-c319-4af9-971a-32b17b1a0361', 'description': 'shared-subnet'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:01:29.658214 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-632f7113-4e42-4d5f-b991-ad997f2ac37d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:01:29.668485 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-632f7113-4e42-4d5f-b991-ad997f2ac37d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:01:29.751664 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-632f7113-4e42-4d5f-b991-ad997f2ac37d admin admin] Made reservation on behalf of e2ab804b512c45babfbcdb37975d5c67 for: {'subnet': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:01:29.754059 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-632f7113-4e42-4d5f-b991-ad997f2ac37d admin admin] Notify callbacks [] for subnet, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:30.228786 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-632f7113-4e42-4d5f-b991-ad997f2ac37d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303'] for subnet, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:30.233719 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:01:30.300849 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632f7113-4e42-4d5f-b991-ad997f2ac37d admin admin] Pushing event updated for resources: {'Subnet': ['ID=085f1fc7-30e6-43bf-8c84-be1266ce2fda,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:01:30.308595 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-632f7113-4e42-4d5f-b991-ad997f2ac37d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:01:30.309459 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-632f7113-4e42-4d5f-b991-ad997f2ac37d admin admin] Checking segment: {'id': '23fb1f68-b8b8-40f2-b730-865b14c5c5f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'c0c2a0bb-c319-4af9-971a-32b17b1a0361'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92565) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:01:30.309835 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-632f7113-4e42-4d5f-b991-ad997f2ac37d admin admin] Network hostable DHCP agents. Network: c0c2a0bb-c319-4af9-971a-32b17b1a0361, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92565) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:01:30.437364 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-632f7113-4e42-4d5f-b991-ad997f2ac37d admin admin] Network c0c2a0bb-c319-4af9-971a-32b17b1a0361 is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92565) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:01:30.528996 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-632f7113-4e42-4d5f-b991-ad997f2ac37d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, c0c2a0bb-c319-4af9-971a-32b17b1a0361) {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:01:30.535021 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-632f7113-4e42-4d5f-b991-ad997f2ac37d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:01:30.535969 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-632f7113-4e42-4d5f-b991-ad997f2ac37d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:30.541346 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8435b0f6-aea2-41ec-b629-111a4c751c1e None None] Network c0c2a0bb-c319-4af9-971a-32b17b1a0361 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:01:30.632823 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-632f7113-4e42-4d5f-b991-ad997f2ac37d admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.9826510
Jun 01 10:01:30.788212 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ec86312-457d-532c-ad41-c4edfccc592e-c0c2a0bb-c319-4af9-971a-32b17b1a0361', 'network_id': 'c0c2a0bb-c319-4af9-971a-32b17b1a0361', 'tenant_id': 'e2ab804b512c45babfbcdb37975d5c67', 'fixed_ips': [{'subnet_id': '085f1fc7-30e6-43bf-8c84-be1266ce2fda'}]}} from dv-cinder-787262-4-iscsi. {{(pid=92567) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 10:01:30.789097 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:30.944821 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.db_base_plugin_common [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Allocated IP 192.168.233.2 (c0c2a0bb-c319-4af9-971a-32b17b1a0361/085f1fc7-30e6-43bf-8c84-be1266ce2fda/39ca5f3a-4344-40e1-88c9-9a6c34699be2) {{(pid=92567) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:01:31.156647 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Notify callbacks [] for port, precommit_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:31.167964 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Transition to ACTIVE for port object 39ca5f3a-4344-40e1-88c9-9a6c34699be2 will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:01:31.186515 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Transition to ACTIVE for port object 39ca5f3a-4344-40e1-88c9-9a6c34699be2 will not be triggered until provisioned by entity DHCP. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:01:31.301133 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:31.306149 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:01:31.371524 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Network c0c2a0bb-c319-4af9-971a-32b17b1a0361 is already hosted by enough agents. {{(pid=92567) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:01:31.374054 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.base_scheduler [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Resources bound (agent type, host, resource id):  {{(pid=92567) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:01:31.378387 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Received port after_create {{(pid=92567) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:01:31.380556 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Pushing event updated for resources: {'Port': ['ID=39ca5f3a-4344-40e1-88c9-9a6c34699be2,revision_number=1']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:01:31.413932 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:31.414271 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:31.414606 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:31.414953 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:31.415278 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:31.415601 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:31.415921 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:31.416239 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:31.416574 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:31.417084 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:31.417658 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:31.417658 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:01:31.425462 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:01:31.482781 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Attempting to bind port 39ca5f3a-4344-40e1-88c9-9a6c34699be2 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:01:31.483183 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Attempting to bind port 39ca5f3a-4344-40e1-88c9-9a6c34699be2 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '23fb1f68-b8b8-40f2-b730-865b14c5c5f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'c0c2a0bb-c319-4af9-971a-32b17b1a0361'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:01:31.483551 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Attempting to bind port 39ca5f3a-4344-40e1-88c9-9a6c34699be2 on network c0c2a0bb-c319-4af9-971a-32b17b1a0361 {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:01:31.489187 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 1, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:01:31.489562 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Checking segment: {'id': '23fb1f68-b8b8-40f2-b730-865b14c5c5f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'c0c2a0bb-c319-4af9-971a-32b17b1a0361'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:01:31.489955 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:31.490382 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Bound using segment: {'id': '23fb1f68-b8b8-40f2-b730-865b14c5c5f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'c0c2a0bb-c319-4af9-971a-32b17b1a0361'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:01:31.490871 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Bound port: 39ca5f3a-4344-40e1-88c9-9a6c34699be2, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '23fb1f68-b8b8-40f2-b730-865b14c5c5f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'c0c2a0bb-c319-4af9-971a-32b17b1a0361'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:01:31.491248 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:31.580251 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] For port 39ca5f3a-4344-40e1-88c9-9a6c34699be2, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:01:31.583492 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] For port 39ca5f3a-4344-40e1-88c9-9a6c34699be2, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=39ca5f3a-4344-40e1-88c9-9a6c34699be2,segment=NetworkSegment(23fb1f68-b8b8-40f2-b730-865b14c5c5f3),segment_id=23fb1f68-b8b8-40f2-b730-865b14c5c5f3)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:01:31.649487 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:31.653499 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:01:31.734331 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Pushing event updated for resources: {'Port': ['ID=39ca5f3a-4344-40e1-88c9-9a6c34699be2,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:01:31.737443 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:01:32.565184 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aba64249-59c0-4ef9-b8c7-0cfb0602406e None None] Network c0c2a0bb-c319-4af9-971a-32b17b1a0361 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:01:32.720967 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-21753e37-7af1-4b26-881b-45685c82af61 None None] Provisioning for port 39ca5f3a-4344-40e1-88c9-9a6c34699be2 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:01:33.185012 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 39ca5f3a-4344-40e1-88c9-9a6c34699be2 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:01:33.355479 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 39ca5f3a-4344-40e1-88c9-9a6c34699be2 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:01:33.360534 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 39ca5f3a-4344-40e1-88c9-9a6c34699be2 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:01:33.360897 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:33.479742 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:33.513259 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 39ca5f3a-4344-40e1-88c9-9a6c34699be2, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=39ca5f3a-4344-40e1-88c9-9a6c34699be2,segment=NetworkSegment(23fb1f68-b8b8-40f2-b730-865b14c5c5f3),segment_id=23fb1f68-b8b8-40f2-b730-865b14c5c5f3)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:01:33.580688 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:33.582829 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:01:33.649246 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=39ca5f3a-4344-40e1-88c9-9a6c34699be2,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:01:33.652209 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:01:35.163817 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 39ca5f3a-4344-40e1-88c9-9a6c34699be2 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:01:35.234938 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 39ca5f3a-4344-40e1-88c9-9a6c34699be2 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:01:35.235299 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:40.472128 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7c8571a9-66e0-4150-bf5c-6b4b6ec5d51d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:42.929634 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-64dd068e-4030-4e27-8d02-e0be161a57a5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:43.197743 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:43.955606 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:45.722910 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:01:57.473023 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 5 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:02:10.449299 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-681978b8-95be-485f-9070-513063ba5239 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:02:12.946061 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-52bc38ef-a4d9-4e17-949b-5a3ac9b6251a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:02:13.235619 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:02:13.967136 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:02:15.715067 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:02:34.471599 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 5 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:02:40.442718 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-ef4d449d-f149-4a79-8860-a7dc7d65579d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:02:42.921059 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-996eb355-9b5b-4343-af14-3a9e5f6e6766 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:02:43.229424 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:02:43.957072 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:02:45.712042 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:02:46.997317 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56204) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:02:47.003780 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [None req-c7a0b351-f94a-4cb6-bdcd-5654ab684872 tempest-verify_tempest_config-852372255 tempest-verify_tempest_config-852372255-project] http://10.222.0.68:9696/v2.0/extensions returned with HTTP 200 {{(pid=92565) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 10:02:47.005014 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-c7a0b351-f94a-4cb6-bdcd-5654ab684872 tempest-verify_tempest_config-852372255 tempest-verify_tempest_config-852372255-project] 10.222.0.68 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13635 time: 0.0067394
Jun 01 10:02:47.473827 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56222) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:02:47.588746 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:02:47.603160 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:02:47.606873 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Usage tracker for resource:security_group_rule and tenant:3bc7187c294943399bcfcd60e5928294 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:02:47.609637 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:02:47.615471 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:02:47.696663 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:02:47.751240 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:02:47.758823 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-19bcc26d-7c56-4264-9425-ce3755158129 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:02:47.798690 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Synchronizing usage tracker for tenant:e2ab804b512c45babfbcdb37975d5c67 on resource:security_group {{(pid=92565) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:02:47.801912 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1312b69-d953-472f-b123-aac0600147b6,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:02:47.811264 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:02:47.811828 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:02:47.812381 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:02:47.812723 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:02:47.813046 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:02:47.813458 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:02:47.814021 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:02:47.814558 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:02:47.814936 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:02:47.815262 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:02:47.815578 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:02:47.815889 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:02:47.822245 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:02:47.905529 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Unset dirty status for tenant:e2ab804b512c45babfbcdb37975d5c67 on resource:security_group {{(pid=92565) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:02:47.906756 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=3bc7187c294943399bcfcd60e5928294&name=default HTTP/1.1" status: 200  len: 2975 time: 0.4319913
Jun 01 10:02:47.909471 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56228) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:02:47.967683 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6ae5c0bd-9b8d-4372-b791-db1e505d2430 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:02:47.993153 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6ae5c0bd-9b8d-4372-b791-db1e505d2430 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:02:48.155233 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6ae5c0bd-9b8d-4372-b791-db1e505d2430 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:02:48.160115 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:02:48.172467 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ae5c0bd-9b8d-4372-b791-db1e505d2430 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1312b69-d953-472f-b123-aac0600147b6,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:02:48.174655 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-6ae5c0bd-9b8d-4372-b791-db1e505d2430 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:02:48.177061 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6ae5c0bd-9b8d-4372-b791-db1e505d2430 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:02:48.177851 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-6ae5c0bd-9b8d-4372-b791-db1e505d2430 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/b1312b69-d953-472f-b123-aac0600147b6 HTTP/1.1" status: 204  len: 168 time: 0.2675135
Jun 01 10:03:10.436991 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-48ff6c5b-bf09-4422-a501-746cdd221db0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:03:11.470657 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 5 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:03:12.943466 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-70ee7aee-b6f7-4463-9b99-b79332397027 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:03:13.212111 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:03:13.971980 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:03:15.717180 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:03:40.465171 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-ea0ef5fa-bcd2-4b0f-b844-c0a54144a6ae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:03:42.937600 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-327bfd2c-d8ca-49ad-99ad-4ce16aaaabe6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:03:43.207747 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:03:43.962146 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:03:45.722101 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:03:48.469103 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 5 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:04:10.446043 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-e26018f2-76f8-4618-b2e7-e77077172bd1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:04:12.933652 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-274d0c25-af2f-441e-b77c-607f64d0a526 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:04:13.224887 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:04:13.973453 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:04:15.722256 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:04:25.468392 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 5 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:04:26.162391 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510'] for agent, after_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:04:29.810155 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56280) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:04:29.923485 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-1d52c02f-8b78-423c-8398-a304cc3a8375 admin admin] 10.222.0.68 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.1121862
Jun 01 10:04:32.036873 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56290) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:04:32.091697 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-71b070c3-746c-4146-95ba-796fc95a6783 admin admin] 10.222.0.68 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.0537434
Jun 01 10:04:40.464972 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-998712dc-df36-49d3-a3a5-3ffd8e3d7718 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:04:42.916308 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-79f2bee3-b07c-49e6-9257-f027804072af None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:04:43.207550 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:04:43.983318 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:04:45.762322 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:04:56.042006 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:05:02.466692 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:05:10.441952 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-0162afc4-3d68-4c4b-b31c-d997fd37dcae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:05:12.936926 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-5d30e873-d3d3-4763-8615-a036324cf831 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:05:13.201742 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:05:13.990563 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:05:15.722163 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:05:26.074650 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:05:39.466705 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:05:40.434711 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7ebc9954-e47d-4863-b697-e93c4b9b5596 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:05:42.925758 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-affe61e7-4eff-4b4d-a99f-08bcc3c930f1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:05:43.253189 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:05:43.977245 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:05:45.732922 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:05:56.070319 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:05:59.310387 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56446) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:05:59.737067 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-329751285-network', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:05:59.742803 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:05:59.748012 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Usage tracker for resource:network and tenant:d13dc1de700d428a8982ca87f11948d0 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:05:59.751209 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:05:59.761242 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:05:59.818686 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Made reservation on behalf of d13dc1de700d428a8982ca87f11948d0 for: {'network': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:05:59.821078 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:05:59.837526 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:05:59.853369 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:05:59.857363 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Usage tracker for resource:security_group_rule and tenant:d13dc1de700d428a8982ca87f11948d0 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:05:59.860333 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:05:59.868223 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:05:59.962804 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:00.040133 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:00.045556 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f4cd0232-b0d6-42e4-8783-01933955e51b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:00.072670 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 860}  {{(pid=92565) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:06:00.080906 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=83cd1cf9-b375-48d4-98e6-e6a6677acde3,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:00.090078 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:00.090421 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.segments_db [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Added segment 2f350557-5423-4a12-a64b-0bf55f2578e6 of type vlan for network 3d9ff4d3-b145-4108-a593-976a9cfb63dc
Jun 01 10:06:00.092157 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:00.092517 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:00.092851 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:00.093185 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:00.093505 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:00.093844 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:00.094168 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:00.094487 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:00.094806 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:00.095154 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:00.095469 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:00.095782 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Tracked resource versions report:
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]: pushed versions:
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]: {   'AddressGroup': {'1.2'},
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:     'ConntrackHelper': {'1.0'},
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:     'Log': {'1.0'},
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:     'Network': {'1.1'},
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:     'Port': {'1.7'},
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:     'PortForwarding': {'1.2'},
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:     'QosPolicy': {'1.8'},
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:     'SecurityGroup': {'1.4'},
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:     'SecurityGroupRule': {'1.2'},
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:     'SubPort': {'1.0'},
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:     'Subnet': {'1.1'},
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:     'Trunk': {'1.1'}}
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]: consumer versions:
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]: {   DHCP agent@dv-cinder-787262-4-iscsi: {},
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:     HyperV agent@hv-cinder-78726: {},
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:     L3 agent@dv-cinder-787262-4-iscsi: {},
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:     Metadata agent@dv-cinder-787262-4-iscsi: {},
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:     Metering agent@dv-cinder-787262-4-iscsi: {},
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:     Open vSwitch agent@dv-cinder-787262-4-iscsi: {   'AddressGroup': '1.2',
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'ConntrackHelper': '1.0',
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'Log': '1.0',
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'Network': '1.1',
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'Port': '1.7',
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'PortForwarding': '1.2',
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'QosPolicy': '1.8',
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'SecurityGroup': '1.4',
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'SecurityGroupRule': '1.2',
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'SubPort': '1.0',
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'Subnet': '1.1',
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:                                                      'Trunk': '1.1'}}
Jun 01 10:06:00.096769 dv-cinder-787262-4-iscsi neutron-server[92565]:  {{(pid=92565) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 10:06:00.103333 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:00.124579 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:00.225199 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:00.226571 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:00.229006 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:00.237362 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:00.372496 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Pushing event updated for resources: {'Network': ['ID=3d9ff4d3-b145-4108-a593-976a9cfb63dc,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:00.381461 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:00.383091 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network 3d9ff4d3-b145-4108-a593-976a9cfb63dc details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:06:00.435344 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 883 time: 1.1229684
Jun 01 10:06:00.437976 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56504) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:00.444608 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-305a8800-cd55-41a3-8705-14194847d58a admin admin] Request body: {'subnet': {'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-329751285-subnet', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:00.455864 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-305a8800-cd55-41a3-8705-14194847d58a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:00.465782 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-305a8800-cd55-41a3-8705-14194847d58a admin admin] Usage tracker for resource:subnet and tenant:d13dc1de700d428a8982ca87f11948d0 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:00.470153 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-305a8800-cd55-41a3-8705-14194847d58a admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:00.476817 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-305a8800-cd55-41a3-8705-14194847d58a admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:00.578798 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-305a8800-cd55-41a3-8705-14194847d58a admin admin] Made reservation on behalf of d13dc1de700d428a8982ca87f11948d0 for: {'subnet': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:06:00.581454 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-305a8800-cd55-41a3-8705-14194847d58a admin admin] Notify callbacks [] for subnet, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:00.718381 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56512) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:01.072515 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56534) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:01.088525 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-305a8800-cd55-41a3-8705-14194847d58a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303'] for subnet, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.093804 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-632f7113-4e42-4d5f-b991-ad997f2ac37d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:01.114186 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56542) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:01.156012 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-515566851-network', 'tenant_id': '17dcefd313724cf2abaacb81a9e0729c'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:01.167219 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:01.169778 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-305a8800-cd55-41a3-8705-14194847d58a admin admin] Pushing event updated for resources: {'Subnet': ['ID=2a00a573-a4bb-4d2d-a3e6-7aef03966618,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:01.173212 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-305a8800-cd55-41a3-8705-14194847d58a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:01.173790 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Usage tracker for resource:network and tenant:17dcefd313724cf2abaacb81a9e0729c is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:01.178860 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:01.179154 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-305a8800-cd55-41a3-8705-14194847d58a admin admin] Checking segment: {'id': '2f350557-5423-4a12-a64b-0bf55f2578e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92565) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:06:01.179501 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-305a8800-cd55-41a3-8705-14194847d58a admin admin] Network hostable DHCP agents. Network: 3d9ff4d3-b145-4108-a593-976a9cfb63dc, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92565) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:06:01.186205 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:01.258193 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-156424351-network', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:01.264319 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:01.268773 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Usage tracker for resource:network and tenant:f4f6f875519045a39c1fdbadd53ce517 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:01.274021 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:01.278289 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:01.322114 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Made reservation on behalf of 17dcefd313724cf2abaacb81a9e0729c for: {'network': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:06:01.324500 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.337818 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.350379 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-305a8800-cd55-41a3-8705-14194847d58a admin admin] Network 3d9ff4d3-b145-4108-a593-976a9cfb63dc is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92565) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:06:01.352936 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:01.356990 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Usage tracker for resource:security_group_rule and tenant:17dcefd313724cf2abaacb81a9e0729c is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:01.370017 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:01.370017 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Made reservation on behalf of f4f6f875519045a39c1fdbadd53ce517 for: {'network': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:06:01.370860 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.386309 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:01.388565 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.411741 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:01.422680 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Usage tracker for resource:security_group_rule and tenant:f4f6f875519045a39c1fdbadd53ce517 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:01.427897 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:01.436564 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:01.453014 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-305a8800-cd55-41a3-8705-14194847d58a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, 3d9ff4d3-b145-4108-a593-976a9cfb63dc) {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:01.463428 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-990f852c-cc53-4368-b567-357bd0fb363f None None] Network 3d9ff4d3-b145-4108-a593-976a9cfb63dc requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:06:01.464745 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-305a8800-cd55-41a3-8705-14194847d58a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:01.465347 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-305a8800-cd55-41a3-8705-14194847d58a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.545582 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-305a8800-cd55-41a3-8705-14194847d58a admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.1060495
Jun 01 10:06:01.548126 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56556) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:01.555014 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:01.555260 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.571142 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:01.581109 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Usage tracker for resource:router and tenant:d13dc1de700d428a8982ca87f11948d0 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:01.589398 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:01.590202 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1852296292-network', 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:01.597778 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:01.601200 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:01.606801 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Usage tracker for resource:network and tenant:ef4bc75ba53a44cca2e4b7c2b8aeb818 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:01.610959 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:01.618963 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:01.634701 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.641844 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.642710 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:01.671288 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-405701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15802'] for router, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.673239 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-407493', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-403482', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-465655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-15793'] for router, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.681937 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=359b5e3e-b771-4b76-a686-039a3ab485cd,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:01.691142 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 882}  {{(pid=92566) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:06:01.698786 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:01.699406 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:01.699894 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:01.700388 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:01.700882 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:01.701536 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:01.701647 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.702207 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:01.702722 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:01.703096 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Tracked resource versions report:
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]: pushed versions:
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]: {   'AddressGroup': {'1.2'},
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:     'ConntrackHelper': {'1.0'},
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:     'Log': {'1.0'},
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:     'Network': {'1.1'},
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:     'Port': {'1.7'},
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:     'PortForwarding': {'1.2'},
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:     'QosPolicy': {'1.8'},
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:     'SecurityGroup': {'1.4'},
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:     'SecurityGroupRule': {'1.2'},
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:     'SubPort': {'1.0'},
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:     'Subnet': {'1.1'},
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:     'Trunk': {'1.1'}}
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]: consumer versions:
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]: {   DHCP agent@dv-cinder-787262-4-iscsi: {},
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:     HyperV agent@hv-cinder-78726: {},
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:     L3 agent@dv-cinder-787262-4-iscsi: {},
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:     Metadata agent@dv-cinder-787262-4-iscsi: {},
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:     Metering agent@dv-cinder-787262-4-iscsi: {},
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:     Open vSwitch agent@dv-cinder-787262-4-iscsi: {   'AddressGroup': '1.2',
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'ConntrackHelper': '1.0',
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'Log': '1.0',
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'Network': '1.1',
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'Port': '1.7',
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'PortForwarding': '1.2',
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'QosPolicy': '1.8',
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'SecurityGroup': '1.4',
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'SecurityGroupRule': '1.2',
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'SubPort': '1.0',
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'Subnet': '1.1',
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:                                                      'Trunk': '1.1'}}
Jun 01 10:06:01.706957 dv-cinder-787262-4-iscsi neutron-server[92566]:  {{(pid=92566) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 10:06:01.709167 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:01.719813 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.720362 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.segments_db [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Added segment db85cbc8-d6a7-4b73-b511-b419c581a2fb of type vlan for network fc9aa7d4-2600-448e-b2e4-9004cbcee079
Jun 01 10:06:01.734647 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Made reservation on behalf of ef4bc75ba53a44cca2e4b7c2b8aeb818 for: {'network': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:06:01.746776 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.758826 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.764490 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.786674 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:01.820970 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a27f15a2-b6b3-4fd7-9c0b-eb4385956ca2,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:01.824499 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:01.830860 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.834816 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:01.842492 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ec86312-457d-532c-ad41-c4edfccc592e-3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618'}]}} from dv-cinder-787262-4-iscsi. {{(pid=92567) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 10:06:01.843583 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.846786 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Usage tracker for resource:security_group_rule and tenant:ef4bc75ba53a44cca2e4b7c2b8aeb818 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:01.855930 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:01.881168 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 861}  {{(pid=92566) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:06:01.884406 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:01.947847 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:01.948196 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.segments_db [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Added segment 718fdfa6-b13d-46f9-85ca-8438bc5d308c of type vlan for network be546533-cf92-483d-9e38-7d14ca9c4902
Jun 01 10:06:02.035269 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:02.044798 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:02.080242 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:02.080959 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:02.124561 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.db_base_plugin_common [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Allocated IP 172.20.0.2 (3d9ff4d3-b145-4108-a593-976a9cfb63dc/2a00a573-a4bb-4d2d-a3e6-7aef03966618/3aa4d326-15d8-4949-83b8-93a38e3c8666) {{(pid=92567) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:06:02.133716 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-ff16e25b-211e-4670-84af-f7b3bab1d45c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:02.314311 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 1.5938771
Jun 01 10:06:02.315463 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:02.335414 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56578) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:02.350005 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:02.350999 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:02.398830 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-7e24c566-4ba7-4fa3-9eca-ece0c1adb958 admin admin] Request body: {'subnet': {'network_id': 'fc9aa7d4-2600-448e-b2e4-9004cbcee079', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-515566851-subnet', 'tenant_id': '17dcefd313724cf2abaacb81a9e0729c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:02.421786 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-403519', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-405751', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-15815'] for router, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:02.496670 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:02.501788 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-7e24c566-4ba7-4fa3-9eca-ece0c1adb958 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:02.504789 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Pushing event updated for resources: {'Network': ['ID=fc9aa7d4-2600-448e-b2e4-9004cbcee079,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:02.509017 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.375s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:02.509552 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.117s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:02.528043 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-7e24c566-4ba7-4fa3-9eca-ece0c1adb958 admin admin] Usage tracker for resource:subnet and tenant:17dcefd313724cf2abaacb81a9e0729c is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:02.531485 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network fc9aa7d4-2600-448e-b2e4-9004cbcee079 details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:06:02.534594 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-7e24c566-4ba7-4fa3-9eca-ece0c1adb958 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:02.600024 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-7e24c566-4ba7-4fa3-9eca-ece0c1adb958 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:02.603394 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:02.608535 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 889 time: 1.5319903
Jun 01 10:06:02.610387 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56594) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:02.644705 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 859}  {{(pid=92566) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:06:02.656781 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:02.657173 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.segments_db [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Added segment 3982460c-82d6-48e1-a5bd-5d7cbbe910af of type vlan for network 34268ce8-8baf-41d5-acbc-1b6c167dd481
Jun 01 10:06:02.675176 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-6238ff4f-299c-4442-9a0e-1fdffc4bf616 admin admin] Request body: {'subnet': {'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-subnet', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:02.679846 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6238ff4f-299c-4442-9a0e-1fdffc4bf616 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:02.684072 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6238ff4f-299c-4442-9a0e-1fdffc4bf616 admin admin] Usage tracker for resource:subnet and tenant:f4f6f875519045a39c1fdbadd53ce517 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:02.687202 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6238ff4f-299c-4442-9a0e-1fdffc4bf616 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:02.694249 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6238ff4f-299c-4442-9a0e-1fdffc4bf616 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:02.739940 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Pushing event updated for resources: {'Network': ['ID=be546533-cf92-483d-9e38-7d14ca9c4902,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:02.757126 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:02.757126 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.054s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:02.757486 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network be546533-cf92-483d-9e38-7d14ca9c4902 details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:06:02.773254 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:02.803519 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Notify callbacks [] for port, precommit_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:02.811006 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=08fd5072-fefe-41fa-99a7-81ac5461f2b4,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:02.816451 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:02.820983 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Transition to ACTIVE for port object 3aa4d326-15d8-4949-83b8-93a38e3c8666 will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:02.860193 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6238ff4f-299c-4442-9a0e-1fdffc4bf616 admin admin] Made reservation on behalf of f4f6f875519045a39c1fdbadd53ce517 for: {'subnet': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:06:02.863712 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6238ff4f-299c-4442-9a0e-1fdffc4bf616 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:02.881842 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e24c566-4ba7-4fa3-9eca-ece0c1adb958 admin admin] Made reservation on behalf of 17dcefd313724cf2abaacb81a9e0729c for: {'subnet': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:06:02.884993 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7e24c566-4ba7-4fa3-9eca-ece0c1adb958 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:02.906609 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Transition to ACTIVE for port object 3aa4d326-15d8-4949-83b8-93a38e3c8666 will not be triggered until provisioned by entity DHCP. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:03.027766 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:03.033219 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:03.033805 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:03.055493 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:03.059661 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:03.069037 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-5e1a11c3-a89e-42ac-a23e-543c6ffb5df9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:03.086036 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:03.093041 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:03.195891 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Network 3d9ff4d3-b145-4108-a593-976a9cfb63dc is already hosted by enough agents. {{(pid=92567) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:03.199002 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.base_scheduler [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Resources bound (agent type, host, resource id):  {{(pid=92567) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:03.203148 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Received port after_create {{(pid=92567) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:06:03.215136 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Pushing event updated for resources: {'Port': ['ID=3aa4d326-15d8-4949-83b8-93a38e3c8666,revision_number=1']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:03.259722 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:03.261426 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:03.261931 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:03.262418 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:03.263101 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:03.263927 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:03.264402 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:03.264882 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:03.265365 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:03.265827 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:03.266316 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:03.266783 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Tracked resource versions report:
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]: pushed versions:
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]: {   'AddressGroup': {'1.2'},
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:     'ConntrackHelper': {'1.0'},
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:     'Log': {'1.0'},
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:     'Network': {'1.1'},
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:     'Port': {'1.7'},
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:     'PortForwarding': {'1.2'},
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:     'QosPolicy': {'1.8'},
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:     'SecurityGroup': {'1.4'},
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:     'SecurityGroupRule': {'1.2'},
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:     'SubPort': {'1.0'},
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:     'Subnet': {'1.1'},
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:     'Trunk': {'1.1'}}
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]: consumer versions:
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]: {   DHCP agent@dv-cinder-787262-4-iscsi: {},
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:     HyperV agent@hv-cinder-78726: {},
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:     L3 agent@dv-cinder-787262-4-iscsi: {},
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:     Metadata agent@dv-cinder-787262-4-iscsi: {},
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:     Metering agent@dv-cinder-787262-4-iscsi: {},
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:     Open vSwitch agent@dv-cinder-787262-4-iscsi: {   'AddressGroup': '1.2',
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'ConntrackHelper': '1.0',
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'Log': '1.0',
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'Network': '1.1',
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'Port': '1.7',
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'PortForwarding': '1.2',
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'QosPolicy': '1.8',
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'SecurityGroup': '1.4',
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'SecurityGroupRule': '1.2',
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'SubPort': '1.0',
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'Subnet': '1.1',
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:                                                      'Trunk': '1.1'}}
Jun 01 10:06:03.268502 dv-cinder-787262-4-iscsi neutron-server[92567]:  {{(pid=92567) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 10:06:03.279060 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:03.282552 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Allocated IP 172.27.2.16 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/a0439258-ab2e-431a-bcd9-3f137ae4d80a) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:06:03.335855 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Attempting to bind port 3aa4d326-15d8-4949-83b8-93a38e3c8666 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:06:03.336223 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Attempting to bind port 3aa4d326-15d8-4949-83b8-93a38e3c8666 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '2f350557-5423-4a12-a64b-0bf55f2578e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:06:03.336819 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Attempting to bind port 3aa4d326-15d8-4949-83b8-93a38e3c8666 on network 3d9ff4d3-b145-4108-a593-976a9cfb63dc {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:03.342994 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 5, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:06:03.343431 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Checking segment: {'id': '2f350557-5423-4a12-a64b-0bf55f2578e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:06:03.343871 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:03.344308 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Bound using segment: {'id': '2f350557-5423-4a12-a64b-0bf55f2578e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:06:03.344782 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Bound port: 3aa4d326-15d8-4949-83b8-93a38e3c8666, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2f350557-5423-4a12-a64b-0bf55f2578e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:06:03.345205 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:03.385805 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Pushing event updated for resources: {'Network': ['ID=34268ce8-8baf-41d5-acbc-1b6c167dd481,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:03.389157 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.303s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:03.402639 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network 34268ce8-8baf-41d5-acbc-1b6c167dd481 details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:06:03.406438 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 892 time: 2.2899559
Jun 01 10:06:03.408506 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56620) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:03.420049 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-db8845f8-ab7d-4430-8771-1c838a9a5c42 admin admin] Request body: {'subnet': {'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1852296292-subnet', 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:03.429353 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-db8845f8-ab7d-4430-8771-1c838a9a5c42 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:03.436514 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-db8845f8-ab7d-4430-8771-1c838a9a5c42 admin admin] Usage tracker for resource:subnet and tenant:ef4bc75ba53a44cca2e4b7c2b8aeb818 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:03.443932 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-db8845f8-ab7d-4430-8771-1c838a9a5c42 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:03.464682 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-db8845f8-ab7d-4430-8771-1c838a9a5c42 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:03.533586 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:03.579732 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db8845f8-ab7d-4430-8771-1c838a9a5c42 admin admin] Made reservation on behalf of ef4bc75ba53a44cca2e4b7c2b8aeb818 for: {'subnet': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:06:03.581951 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-db8845f8-ab7d-4430-8771-1c838a9a5c42 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:03.596908 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] For port 3aa4d326-15d8-4949-83b8-93a38e3c8666, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:06:03.600849 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] For port 3aa4d326-15d8-4949-83b8-93a38e3c8666, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=3aa4d326-15d8-4949-83b8-93a38e3c8666,segment=NetworkSegment(2f350557-5423-4a12-a64b-0bf55f2578e6),segment_id=2f350557-5423-4a12-a64b-0bf55f2578e6)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:06:03.814917 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:03.821990 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-5e1a11c3-a89e-42ac-a23e-543c6ffb5df9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:03.871581 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:03.885483 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:03.899875 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Pushing event updated for resources: {'Port': ['ID=3aa4d326-15d8-4949-83b8-93a38e3c8666,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:03.903389 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:04.006236 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:04.007566 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:04.013591 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:06:04.171359 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7e24c566-4ba7-4fa3-9eca-ece0c1adb958 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303'] for subnet, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:04.200496 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Pushing event updated for resources: {'Port': ['ID=a0439258-ab2e-431a-bcd9-3f137ae4d80a,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:04.200496 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.309s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:04.201574 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a0f3a5bb-f4d4-4bfd-a721-88d8916c834b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:04.374058 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e24c566-4ba7-4fa3-9eca-ece0c1adb958 admin admin] Pushing event updated for resources: {'Subnet': ['ID=acb0c106-1f4c-4cf1-9985-fb4e642b58bb,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:04.393091 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7e24c566-4ba7-4fa3-9eca-ece0c1adb958 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:04.439028 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e24c566-4ba7-4fa3-9eca-ece0c1adb958 admin admin] Checking segment: {'id': 'db85cbc8-d6a7-4b73-b511-b419c581a2fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'fc9aa7d4-2600-448e-b2e4-9004cbcee079'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:06:04.439406 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e24c566-4ba7-4fa3-9eca-ece0c1adb958 admin admin] Network hostable DHCP agents. Network: fc9aa7d4-2600-448e-b2e4-9004cbcee079, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92566) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:06:04.537754 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6238ff4f-299c-4442-9a0e-1fdffc4bf616 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303'] for subnet, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:04.545146 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:04.574881 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e24c566-4ba7-4fa3-9eca-ece0c1adb958 admin admin] Network fc9aa7d4-2600-448e-b2e4-9004cbcee079 is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92566) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:06:04.585981 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:04.679052 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6238ff4f-299c-4442-9a0e-1fdffc4bf616 admin admin] Checking segment: {'id': '718fdfa6-b13d-46f9-85ca-8438bc5d308c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:06:04.679421 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6238ff4f-299c-4442-9a0e-1fdffc4bf616 admin admin] Network hostable DHCP agents. Network: be546533-cf92-483d-9e38-7d14ca9c4902, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92566) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:06:04.696422 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6238ff4f-299c-4442-9a0e-1fdffc4bf616 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f2fdda64-a03c-41d7-8178-daca0363bd6e,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:04.696422 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-7e24c566-4ba7-4fa3-9eca-ece0c1adb958 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, fc9aa7d4-2600-448e-b2e4-9004cbcee079) {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:04.712347 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6238ff4f-299c-4442-9a0e-1fdffc4bf616 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:04.753210 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e24c566-4ba7-4fa3-9eca-ece0c1adb958 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:04.753210 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7e24c566-4ba7-4fa3-9eca-ece0c1adb958 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:04.753507 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89c58226-8577-426b-b38d-2b98733bcc38 None None] Network fc9aa7d4-2600-448e-b2e4-9004cbcee079 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:06:04.788970 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-db8845f8-ab7d-4430-8771-1c838a9a5c42 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303'] for subnet, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:04.840522 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:04.940156 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db8845f8-ab7d-4430-8771-1c838a9a5c42 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2ee54c26-f286-4f9a-b791-24aa84feb26a,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:04.945891 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-db8845f8-ab7d-4430-8771-1c838a9a5c42 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:04.995261 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db8845f8-ab7d-4430-8771-1c838a9a5c42 admin admin] Checking segment: {'id': '3982460c-82d6-48e1-a5bd-5d7cbbe910af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:06:05.024497 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db8845f8-ab7d-4430-8771-1c838a9a5c42 admin admin] Network hostable DHCP agents. Network: 34268ce8-8baf-41d5-acbc-1b6c167dd481, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92566) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:06:05.025283 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99872fa8-8376-4bee-8cf5-d40ec0aeb745 None None] Network fc9aa7d4-2600-448e-b2e4-9004cbcee079 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:06:05.043042 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6238ff4f-299c-4442-9a0e-1fdffc4bf616 admin admin] Network be546533-cf92-483d-9e38-7d14ca9c4902 is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92566) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:06:05.057306 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-6238ff4f-299c-4442-9a0e-1fdffc4bf616 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, be546533-cf92-483d-9e38-7d14ca9c4902) {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:05.071221 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6238ff4f-299c-4442-9a0e-1fdffc4bf616 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:05.072570 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6238ff4f-299c-4442-9a0e-1fdffc4bf616 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:05.080225 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-7e24c566-4ba7-4fa3-9eca-ece0c1adb958 admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 2.7207825
Jun 01 10:06:05.107693 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97effeec-f674-4ef7-b948-2eef4199a462 None None] Network be546533-cf92-483d-9e38-7d14ca9c4902 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:06:05.120211 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-405708', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-403580'] for router, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:05.126225 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db8845f8-ab7d-4430-8771-1c838a9a5c42 admin admin] Network 34268ce8-8baf-41d5-acbc-1b6c167dd481 is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92566) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:06:05.174751 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-6238ff4f-299c-4442-9a0e-1fdffc4bf616 admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 852 time: 2.5497110
Jun 01 10:06:05.177894 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56666) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:05.193752 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:05.213359 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:05.228851 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-db8845f8-ab7d-4430-8771-1c838a9a5c42 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, 34268ce8-8baf-41d5-acbc-1b6c167dd481) {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:05.237813 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db8845f8-ab7d-4430-8771-1c838a9a5c42 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:05.238680 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-db8845f8-ab7d-4430-8771-1c838a9a5c42 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:05.250773 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28ca4d22-3d7b-4a1b-a9d9-e1012844c8bf None None] Network 34268ce8-8baf-41d5-acbc-1b6c167dd481 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:06:05.262189 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Usage tracker for resource:router and tenant:f4f6f875519045a39c1fdbadd53ce517 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:05.274655 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:05.296165 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:05.409759 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-405701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15802'] for router, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:05.411038 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-407493', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-403482', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-465655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-15793'] for router, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:05.464354 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-db8845f8-ab7d-4430-8771-1c838a9a5c42 admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 856 time: 2.0524023
Jun 01 10:06:05.472600 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56680) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:05.480321 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:05.515121 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1852296292-router', 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:05.536840 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:05.557032 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Usage tracker for resource:router and tenant:ef4bc75ba53a44cca2e4b7c2b8aeb818 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:05.567573 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:05.586661 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:05.654204 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20e82bae-1869-4069-9ea7-a795f6a8d525 None None] Network 3d9ff4d3-b145-4108-a593-976a9cfb63dc requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:06:05.673660 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 3aa4d326-15d8-4949-83b8-93a38e3c8666 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:05.694300 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-405701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15802'] for router, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:05.701303 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-407493', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-403482', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-465655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-15793'] for router, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:05.741685 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:05.756316 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Router d0653611-f9db-4b67-b4b2-4c0789fb691f is scheduled to L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c with binding_index 1 {{(pid=92565) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 10:06:05.818505 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ec86312-457d-532c-ad41-c4edfccc592e-be546533-cf92-483d-9e38-7d14ca9c4902', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e'}]}} from dv-cinder-787262-4-iscsi. {{(pid=92567) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 10:06:05.819355 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:05.864629 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5f09d80-78dc-40bb-a72d-a682575cac42 None None] Network 34268ce8-8baf-41d5-acbc-1b6c167dd481 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:06:06.014038 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56716) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:06.040618 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:06:06.055671 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Sync routers for ids ['d0653611-f9db-4b67-b4b2-4c0789fb691f'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:06:06.067160 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Routers {'d0653611-f9db-4b67-b4b2-4c0789fb691f'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:06:06.068373 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7272d3d0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:05:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d0653611-f9db-4b67-b4b2-4c0789fb691f'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:06.105056 dv-cinder-787262-4-iscsi neutron-server[92566]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
Jun 01 10:06:06.283601 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-403519', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-405751', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-15815'] for router, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:06.312382 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Notify callbacks [] for router, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:06.316222 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] 10.222.0.68 "POST /v2.0/routers HTTP/1.1" status: 201  len: 921 time: 4.7645545
Jun 01 10:06:06.318404 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56722) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:06.328816 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-403519', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-405751', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-15815'] for router, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:06.349156 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-a9dd1488-daf5-4d87-8a22-6b5385138f9e None None] Provisioning for port 3aa4d326-15d8-4949-83b8-93a38e3c8666 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:06.358037 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Set router d0653611-f9db-4b67-b4b2-4c0789fb691f gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:06:06.441664 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.db_base_plugin_common [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Allocated IP 172.20.0.2 (be546533-cf92-483d-9e38-7d14ca9c4902/f2fdda64-a03c-41d7-8178-daca0363bd6e/9ae36a44-2229-48a5-8955-f44cea3ffab0) {{(pid=92567) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:06:06.642578 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82580940-9021-41ce-a04d-18275a28fca8 req-68d6342a-8895-438e-af56-2918614e31f8 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:06.643294 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-82580940-9021-41ce-a04d-18275a28fca8 req-68d6342a-8895-438e-af56-2918614e31f8 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Synchronizing usage tracker for tenant:17dcefd313724cf2abaacb81a9e0729c on resource:network {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:06:06.674220 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7272d3d0>, [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:04Z', 'revision_number': 3, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:03Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:06.684891 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Checking router: d0653611-f9db-4b67-b4b2-4c0789fb691f for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:06:06.685258 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Updating router d0653611-f9db-4b67-b4b2-4c0789fb691f port a0439258-ab2e-431a-bcd9-3f137ae4d80a binding host dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:06:06.777027 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 3aa4d326-15d8-4949-83b8-93a38e3c8666 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:06.813044 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:06.850957 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-82580940-9021-41ce-a04d-18275a28fca8 req-68d6342a-8895-438e-af56-2918614e31f8 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Unset dirty status for tenant:17dcefd313724cf2abaacb81a9e0729c on resource:network {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:06:06.852099 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-68d6342a-8895-438e-af56-2918614e31f8 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/networks?id=fc9aa7d4-2600-448e-b2e4-9004cbcee079 HTTP/1.1" status: 200  len: 811 time: 0.7644978
Jun 01 10:06:06.859129 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 3aa4d326-15d8-4949-83b8-93a38e3c8666 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:06.860389 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:06.943460 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-9927936d-7d92-41b9-8e86-4485b80aa19b tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/quotas/17dcefd313724cf2abaacb81a9e0729c HTTP/1.1" status: 200  len: 375 time: 0.0807700
Jun 01 10:06:07.018574 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-354c7371-c6a9-439a-b558-cade6e713373 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=17dcefd313724cf2abaacb81a9e0729c&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0637674
Jun 01 10:06:07.137421 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:07.227069 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:07.489140 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Notify callbacks [] for port, precommit_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:07.532940 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.provisioning_blocks [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Transition to ACTIVE for port object a0439258-ab2e-431a-bcd9-3f137ae4d80a will not be triggered until provisioned by entity L2. {{(pid=92568) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:07.535027 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Notify callbacks [] for port, precommit_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:07.594661 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Transition to ACTIVE for port object 9ae36a44-2229-48a5-8955-f44cea3ffab0 will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:07.606100 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:07.628450 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:07.637808 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Transition to ACTIVE for port object 9ae36a44-2229-48a5-8955-f44cea3ffab0 will not be triggered until provisioned by entity DHCP. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:07.669232 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:07.669560 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:07.674460 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:07.680883 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 3aa4d326-15d8-4949-83b8-93a38e3c8666, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=3aa4d326-15d8-4949-83b8-93a38e3c8666,segment=NetworkSegment(2f350557-5423-4a12-a64b-0bf55f2578e6),segment_id=2f350557-5423-4a12-a64b-0bf55f2578e6)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:07.754556 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:07.759803 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:07.850657 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Allocated IP 172.27.2.219 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/d943f1f4-e253-47b0-93f0-2e7e1f117536) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:06:07.852028 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:07.852994 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Attempting to bind port a0439258-ab2e-431a-bcd9-3f137ae4d80a on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:06:07.853585 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Attempting to bind port a0439258-ab2e-431a-bcd9-3f137ae4d80a by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:06:07.854365 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Attempting to bind port a0439258-ab2e-431a-bcd9-3f137ae4d80a on network a961b732-0873-4e86-af5a-7e84ae1a2549 {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:07.884651 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 5, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:06:07.885096 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Checking segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92568) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:06:07.885509 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:07.885917 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Bound using segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:06:07.886503 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Bound port: a0439258-ab2e-431a-bcd9-3f137ae4d80a, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:06:07.886887 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:07.903625 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:07.949489 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Pushing event updated for resources: {'Port': ['ID=a0439258-ab2e-431a-bcd9-3f137ae4d80a,revision_number=2']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:07.955696 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Network be546533-cf92-483d-9e38-7d14ca9c4902 is already hosted by enough agents. {{(pid=92567) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:07.959555 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.base_scheduler [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Resources bound (agent type, host, resource id):  {{(pid=92567) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:07.980588 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Received port after_create {{(pid=92567) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:06:08.001601 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Pushing event updated for resources: {'Port': ['ID=9ae36a44-2229-48a5-8955-f44cea3ffab0,revision_number=1']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:08.025116 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Tracked resource versions report:
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]: pushed versions:
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]: {   'AddressGroup': {'1.2'},
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:     'ConntrackHelper': {'1.0'},
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:     'Log': {'1.0'},
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:     'Network': {'1.1'},
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:     'Port': {'1.7'},
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:     'PortForwarding': {'1.2'},
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:     'QosPolicy': {'1.8'},
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:     'SecurityGroup': {'1.4'},
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:     'SecurityGroupRule': {'1.2'},
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:     'SubPort': {'1.0'},
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:     'Subnet': {'1.1'},
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:     'Trunk': {'1.1'}}
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]: consumer versions:
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]: {   DHCP agent@dv-cinder-787262-4-iscsi: {},
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:     HyperV agent@hv-cinder-78726: {},
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:     L3 agent@dv-cinder-787262-4-iscsi: {},
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:     Metadata agent@dv-cinder-787262-4-iscsi: {},
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:     Metering agent@dv-cinder-787262-4-iscsi: {},
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:     Open vSwitch agent@dv-cinder-787262-4-iscsi: {   'AddressGroup': '1.2',
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'ConntrackHelper': '1.0',
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'Log': '1.0',
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'Network': '1.1',
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'Port': '1.7',
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'PortForwarding': '1.2',
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'QosPolicy': '1.8',
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'SecurityGroup': '1.4',
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'SecurityGroupRule': '1.2',
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'SubPort': '1.0',
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'Subnet': '1.1',
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:                                                      'Trunk': '1.1'}}
Jun 01 10:06:08.030122 dv-cinder-787262-4-iscsi neutron-server[92568]:  {{(pid=92568) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 10:06:08.039752 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.365s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:08.079387 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.319s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:08.081155 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.140s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:08.104187 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56772) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:08.108331 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] For port a0439258-ab2e-431a-bcd9-3f137ae4d80a, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92568) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:06:08.119858 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] For port a0439258-ab2e-431a-bcd9-3f137ae4d80a, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=a0439258-ab2e-431a-bcd9-3f137ae4d80a,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92568) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:06:08.185755 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:08.190836 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:08.228375 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56782) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:08.246578 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:08.259128 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-d80e167a-0ff5-4c92-a2bf-3d9adca29cc2 service neutron] http://10.222.0.68:9696/v2.0/extensions returned with HTTP 200 {{(pid=92566) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 10:06:08.262351 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-d80e167a-0ff5-4c92-a2bf-3d9adca29cc2 service neutron] 10.222.0.68 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.2803445
Jun 01 10:06:08.280939 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Attempting to bind port 9ae36a44-2229-48a5-8955-f44cea3ffab0 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:06:08.281320 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Attempting to bind port 9ae36a44-2229-48a5-8955-f44cea3ffab0 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '718fdfa6-b13d-46f9-85ca-8438bc5d308c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:06:08.281685 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Attempting to bind port 9ae36a44-2229-48a5-8955-f44cea3ffab0 on network be546533-cf92-483d-9e38-7d14ca9c4902 {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:08.288439 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-fc8a7b3f-1390-4c4f-aeb7-b479afb468ef None None] Provisioning complete for port 3aa4d326-15d8-4949-83b8-93a38e3c8666 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:08.288825 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-fc8a7b3f-1390-4c4f-aeb7-b479afb468ef None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:08.325068 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 5, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:06:08.325434 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Checking segment: {'id': '718fdfa6-b13d-46f9-85ca-8438bc5d308c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:06:08.325839 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:08.326233 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Bound using segment: {'id': '718fdfa6-b13d-46f9-85ca-8438bc5d308c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:06:08.326723 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Bound port: 9ae36a44-2229-48a5-8955-f44cea3ffab0, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '718fdfa6-b13d-46f9-85ca-8438bc5d308c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:06:08.327122 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:08.360951 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Pushing event updated for resources: {'Port': ['ID=a0439258-ab2e-431a-bcd9-3f137ae4d80a,revision_number=3']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:08.366770 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=3aa4d326-15d8-4949-83b8-93a38e3c8666,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:08.381136 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.300s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:08.389472 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7a8d4263-2fda-4a0e-9102-92a942c436de admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:08.410309 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Routers {'d0653611-f9db-4b67-b4b2-4c0789fb691f'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:06:08.410572 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-7a8d4263-2fda-4a0e-9102-92a942c436de admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:08.411466 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7272d3d0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:05:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d0653611-f9db-4b67-b4b2-4c0789fb691f'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:08.415609 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-7a8d4263-2fda-4a0e-9102-92a942c436de admin admin] Usage tracker for resource:security_group_rule and tenant:c33d270fd83348b9bc7c70bc1dc14d6c is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:08.418974 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-7a8d4263-2fda-4a0e-9102-92a942c436de admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:08.425852 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-7a8d4263-2fda-4a0e-9102-92a942c436de admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:08.535416 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] For port 9ae36a44-2229-48a5-8955-f44cea3ffab0, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:06:08.538174 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7a8d4263-2fda-4a0e-9102-92a942c436de admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:08.540792 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:08.547526 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:08.547709 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-efd13d8c-15b8-447a-97be-be54efb6ed50 service neutron] 10.222.0.68 "GET /v2.0/networks/fc9aa7d4-2600-448e-b2e4-9004cbcee079?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2641399
Jun 01 10:06:08.555004 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] For port 9ae36a44-2229-48a5-8955-f44cea3ffab0, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=9ae36a44-2229-48a5-8955-f44cea3ffab0,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:06:08.601176 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:08.608643 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:08.611380 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:06:08.624466 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b40bd02c-0681-41fc-a8c7-a4713188597a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:08.636590 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.446s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:08.659028 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:08.663155 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-3fe70ca6-4513-49d9-ac4f-12fe5a8bb614 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:08.684981 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7a8d4263-2fda-4a0e-9102-92a942c436de admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:08.697445 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] Set router d0653611-f9db-4b67-b4b2-4c0789fb691f gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:06:08.789545 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-42d9cfc6-23dd-4244-8c69-475bcdf1d91e service neutron] 10.222.0.68 "GET /v2.0/networks/fc9aa7d4-2600-448e-b2e4-9004cbcee079?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2223916
Jun 01 10:06:08.798949 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Pushing event updated for resources: {'Port': ['ID=9ae36a44-2229-48a5-8955-f44cea3ffab0,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:08.806653 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:08.826401 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Allocated IP 172.27.2.236 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/5a1ced49-9531-4fcc-b7ac-004241b95c6b) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:06:08.829938 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Pushing event updated for resources: {'Port': ['ID=d943f1f4-e253-47b0-93f0-2e7e1f117536,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:08.832915 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.285s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:08.849685 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.083s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:08.850920 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Allocated IP 172.20.0.1 (3d9ff4d3-b145-4108-a593-976a9cfb63dc/2a00a573-a4bb-4d2d-a3e6-7aef03966618/7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:06:08.919017 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-7a8d4263-2fda-4a0e-9102-92a942c436de admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=c33d270fd83348b9bc7c70bc1dc14d6c&name=default HTTP/1.1" status: 200  len: 2975 time: 0.6820571
Jun 01 10:06:08.930818 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56796) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:08.972662 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-b40bd02c-0681-41fc-a8c7-a4713188597a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:09.010880 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a8d4263-2fda-4a0e-9102-92a942c436de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5b823f1d-a60c-4852-b4be-fdc81178768d,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:09.013436 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-b40bd02c-0681-41fc-a8c7-a4713188597a admin admin] Usage tracker for resource:security_group_rule and tenant:13b425f072a64179a42cedc8900d9180 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:09.018279 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-b40bd02c-0681-41fc-a8c7-a4713188597a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:09.026683 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7a8d4263-2fda-4a0e-9102-92a942c436de admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:09.028661 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-b40bd02c-0681-41fc-a8c7-a4713188597a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:09.140014 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7272d3d0>, [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:04Z', 'revision_number': 3, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:09.146349 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-118affcb-36cd-4ae1-8a78-19ab78e5c018 None None] The sync data for ids ['d0653611-f9db-4b67-b4b2-4c0789fb691f'] in dv-cinder-787262-4-iscsi is: [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:04Z', 'revision_number': 3, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:06:09.168197 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56810) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:09.204738 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-510e5161-7eed-45aa-bc99-ba3b934228d8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:09.279599 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fc6da099-f100-4c4d-add2-ade72a70faf5 req-fdc5c326-1c48-43fa-959f-72a7a81514f0 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 210 time: 0.1102736
Jun 01 10:06:09.329421 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:09.384126 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Transition to ACTIVE for port object 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 will not be triggered until provisioned by entity DHCP. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:09.391672 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:09.394640 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:09.470636 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b40bd02c-0681-41fc-a8c7-a4713188597a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:09.504571 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-510e5161-7eed-45aa-bc99-ba3b934228d8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:09.550200 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b40bd02c-0681-41fc-a8c7-a4713188597a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:09.569219 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:09.615868 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:09.627401 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:09.637816 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b40bd02c-0681-41fc-a8c7-a4713188597a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=012b04a4-e3d4-4203-9af3-58a9bcb695de,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:09.642104 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b40bd02c-0681-41fc-a8c7-a4713188597a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:09.649563 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-3cc0513e-00c4-4dd7-970b-8f4c77f23c94 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:09.706598 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-b40bd02c-0681-41fc-a8c7-a4713188597a admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=13b425f072a64179a42cedc8900d9180&name=default HTTP/1.1" status: 200  len: 2975 time: 1.5972381
Jun 01 10:06:09.706727 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56834) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:09.753120 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Network 3d9ff4d3-b145-4108-a593-976a9cfb63dc is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:09.764632 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:09.784437 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:09.786101 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:06:09.786868 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-401677'] for router_interface, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:09.800257 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:09.820903 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:06:09.852297 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-510e5161-7eed-45aa-bc99-ba3b934228d8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:09.875862 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7a8d4263-2fda-4a0e-9102-92a942c436de admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:09.926080 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Pushing event updated for resources: {'Port': ['ID=7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:09.953085 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-510e5161-7eed-45aa-bc99-ba3b934228d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5b823f1d-a60c-4852-b4be-fdc81178768d,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:09.959191 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-510e5161-7eed-45aa-bc99-ba3b934228d8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:10.032656 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b528f053-81bd-4896-b5ce-cac398b072ce admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:10.115746 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-510e5161-7eed-45aa-bc99-ba3b934228d8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:10.120012 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-510e5161-7eed-45aa-bc99-ba3b934228d8 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/5b823f1d-a60c-4852-b4be-fdc81178768d HTTP/1.1" status: 204  len: 168 time: 1.1880217
Jun 01 10:06:10.171783 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b528f053-81bd-4896-b5ce-cac398b072ce admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:10.230072 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-405708', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-403580'] for router, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:10.281582 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device a0439258-ab2e-431a-bcd9-3f137ae4d80a up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:10.311922 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Pushing event updated for resources: {'Port': ['ID=5a1ced49-9531-4fcc-b7ac-004241b95c6b,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:10.328597 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-3b818f20-b914-4412-a9bb-6602a38f0a91 None None] Provisioning for port 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:10.333434 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.685s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:10.333882 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.595s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:10.334127 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:10.353403 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1067d3d-7de8-41ad-8f8f-5236bf3b9f86 None None] Network be546533-cf92-483d-9e38-7d14ca9c4902 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:06:10.384698 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-3b818f20-b914-4412-a9bb-6602a38f0a91 None None] Provisioning complete for port 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:10.385064 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-3b818f20-b914-4412-a9bb-6602a38f0a91 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:10.554393 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-3b818f20-b914-4412-a9bb-6602a38f0a91 None None] Port 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:06:10.595860 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b528f053-81bd-4896-b5ce-cac398b072ce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:10.610724 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:10.637634 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b528f053-81bd-4896-b5ce-cac398b072ce admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=012b04a4-e3d4-4203-9af3-58a9bcb695de,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:10.643727 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b528f053-81bd-4896-b5ce-cac398b072ce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:10.656906 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b528f053-81bd-4896-b5ce-cac398b072ce admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:10.660746 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-b528f053-81bd-4896-b5ce-cac398b072ce admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/012b04a4-e3d4-4203-9af3-58a9bcb695de HTTP/1.1" status: 204  len: 168 time: 0.9543357
Jun 01 10:06:10.715238 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:10.747717 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-df5dfd01-db64-45bb-b3ed-a70a2646f798 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:10.747914 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-23365198-6827-472f-b794-d2ad59e0c9d4 req-e36119a2-c09f-45df-8095-fa0cd1a75018 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 210 time: 0.3495831
Jun 01 10:06:10.768004 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port a0439258-ab2e-431a-bcd9-3f137ae4d80a completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:10.791431 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Router 369d44f0-4eb2-4ec0-94e5-1562c07efd26 is scheduled to L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c with binding_index 1 {{(pid=92565) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 10:06:10.796284 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port a0439258-ab2e-431a-bcd9-3f137ae4d80a triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:10.800204 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:10.996358 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-776a07c7-53c0-44a3-98cb-d8c669425152 None None] Provisioning for port 9ae36a44-2229-48a5-8955-f44cea3ffab0 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:11.111715 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:06:11.118238 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:11.126767 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Sync routers for ids ['369d44f0-4eb2-4ec0-94e5-1562c07efd26'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:06:11.136812 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56876) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:11.147631 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port a0439258-ab2e-431a-bcd9-3f137ae4d80a, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=a0439258-ab2e-431a-bcd9-3f137ae4d80a,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:11.148981 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Routers {'369d44f0-4eb2-4ec0-94e5-1562c07efd26'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:06:11.149912 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72698100>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:05:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['369d44f0-4eb2-4ec0-94e5-1562c07efd26'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:11.163846 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-270399ea-67ac-4ca2-828f-13497a8512a4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:11.200233 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-270399ea-67ac-4ca2-828f-13497a8512a4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:11.206848 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-270399ea-67ac-4ca2-828f-13497a8512a4 admin admin] Usage tracker for resource:security_group_rule and tenant:c7355824989242abafdbecc87618404a is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:11.211812 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-270399ea-67ac-4ca2-828f-13497a8512a4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:11.220615 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-270399ea-67ac-4ca2-828f-13497a8512a4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:11.248161 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Notify callbacks [] for router, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:11.251597 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:11.252521 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] 10.222.0.68 "POST /v2.0/routers HTTP/1.1" status: 201  len: 931 time: 5.7791729
Jun 01 10:06:11.253460 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56882) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:11.260593 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 3aa4d326-15d8-4949-83b8-93a38e3c8666 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:11.304001 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:11.334778 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:11.530016 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=a0439258-ab2e-431a-bcd9-3f137ae4d80a,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:11.539452 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:11.547838 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Set router 369d44f0-4eb2-4ec0-94e5-1562c07efd26 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:06:11.588963 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:11.696217 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:11.705019 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7873030', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-401824'] for router_interface, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:11.716620 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:11.840814 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-270399ea-67ac-4ca2-828f-13497a8512a4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:11.869943 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 3aa4d326-15d8-4949-83b8-93a38e3c8666 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:11.870578 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:11.933814 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-270399ea-67ac-4ca2-828f-13497a8512a4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:11.951237 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Pushing event updated for resources: {'Port': ['ID=7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:11.958770 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.241s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:12.014468 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:12.025444 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-270399ea-67ac-4ca2-828f-13497a8512a4 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=c7355824989242abafdbecc87618404a&name=default HTTP/1.1" status: 200  len: 2975 time: 0.8850701
Jun 01 10:06:12.028555 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 56904) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:12.124653 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-270399ea-67ac-4ca2-828f-13497a8512a4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c561afc-d5fc-4342-8465-0b35d6201229,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:12.137785 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-405708', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-403580'] for router, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:12.141275 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6e674a40-54c9-42a7-8a04-95759c7a3e01 req-70506f74-ae3f-4f6b-8fa0-b9698c3e6f7d tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 210 time: 0.1013784
Jun 01 10:06:12.160789 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Network 3d9ff4d3-b145-4108-a593-976a9cfb63dc is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:12.162102 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:12.243464 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-270399ea-67ac-4ca2-828f-13497a8512a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.226s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:12.296500 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 9ae36a44-2229-48a5-8955-f44cea3ffab0 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:12.460729 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72698100>, [{'id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'name': 'tempest-ServerRescueNegativeTestJSON-1852296292-router', 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.219'}], 'enable_snat': True}, 'gw_port_id': 'd943f1f4-e253-47b0-93f0-2e7e1f117536', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:08Z', 'revision_number': 3, 'project_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'gw_port': {'id': 'd943f1f4-e253-47b0-93f0-2e7e1f117536', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:8b:9a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:07Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:12.470715 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Checking router: 369d44f0-4eb2-4ec0-94e5-1562c07efd26 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:06:12.471094 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Updating router 369d44f0-4eb2-4ec0-94e5-1562c07efd26 port d943f1f4-e253-47b0-93f0-2e7e1f117536 binding host dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:06:12.586724 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-df5258fc-74ee-478b-a7ae-d088edc2b775 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:12.591387 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:12.636103 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-df5258fc-74ee-478b-a7ae-d088edc2b775 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:12.764135 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Router d0653611-f9db-4b67-b4b2-4c0789fb691f has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92566) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:06:12.941453 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:12.943907 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 9ae36a44-2229-48a5-8955-f44cea3ffab0 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:12.991319 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Router d65374d4-451b-4890-a2f5-a4bcac5a9a38 is scheduled to L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c with binding_index 1 {{(pid=92566) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 10:06:12.998025 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-70c22789-8909-4b5f-bbfe-193abd6b52a0 None None] Provisioning complete for port 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:12.998025 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-70c22789-8909-4b5f-bbfe-193abd6b52a0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:13.136667 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 9ae36a44-2229-48a5-8955-f44cea3ffab0 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:13.137885 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:13.200836 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Allocated IP 172.20.0.1 (34268ce8-8baf-41d5-acbc-1b6c167dd481/2ee54c26-f286-4f9a-b791-24aa84feb26a/2313fd35-8139-4639-b9e5-bd9fc71943ca) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:06:13.269177 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:06:13.278140 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Sync routers for ids ['d0653611-f9db-4b67-b4b2-4c0789fb691f'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:06:13.295622 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Routers {'d0653611-f9db-4b67-b4b2-4c0789fb691f'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:06:13.296256 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe726a0400>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:05:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d0653611-f9db-4b67-b4b2-4c0789fb691f'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:13.365206 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:13.405696 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-df5258fc-74ee-478b-a7ae-d088edc2b775 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:13.410665 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:13.438972 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df5258fc-74ee-478b-a7ae-d088edc2b775 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c561afc-d5fc-4342-8465-0b35d6201229,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:13.448076 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-df5258fc-74ee-478b-a7ae-d088edc2b775 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:13.454309 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.30', 60210) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:13.459732 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-fc580545-cce6-4497-840d-0a8f474bc14d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:13.496715 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-df5258fc-74ee-478b-a7ae-d088edc2b775 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:13.499026 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-df5258fc-74ee-478b-a7ae-d088edc2b775 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/5c561afc-d5fc-4342-8465-0b35d6201229 HTTP/1.1" status: 204  len: 168 time: 1.4664674
Jun 01 10:06:13.557281 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:13.557481 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-36612c91-b64b-4d6b-a76c-5786ad0c4af4 req-d7453edb-9e3a-468f-93f9-013fffc28ecc tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 210 time: 0.0742671
Jun 01 10:06:13.565681 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:06:13.567254 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7acda561-f7b9-4153-88f3-9ae520513c93 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:13.572419 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] 10.222.0.68 "PUT /v2.0/routers/d0653611-f9db-4b67-b4b2-4c0789fb691f/add_router_interface HTTP/1.1" status: 200  len: 503 time: 7.2549324
Jun 01 10:06:13.634554 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Sync routers for ids ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:06:13.650758 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Network 34268ce8-8baf-41d5-acbc-1b6c167dd481 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:13.651293 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-70c22789-8909-4b5f-bbfe-193abd6b52a0 None None] Port 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:06:13.653261 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:13.656660 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:13.666307 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:06:13.666795 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-401677'] for router_interface, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:13.675831 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Notify callbacks [] for router, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:13.680001 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] 10.222.0.68 "POST /v2.0/routers HTTP/1.1" status: 201  len: 928 time: 8.5005980
Jun 01 10:06:13.680745 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 56982) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:13.844986 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Routers {'d65374d4-451b-4890-a2f5-a4bcac5a9a38'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:06:13.845628 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72759490>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:06:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:13.915671 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Set router d0653611-f9db-4b67-b4b2-4c0789fb691f gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:06:13.915842 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Pushing event updated for resources: {'Port': ['ID=2313fd35-8139-4639-b9e5-bd9fc71943ca,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:13.965274 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.398s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:14.036821 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82580940-9021-41ce-a04d-18275a28fca8 req-264175ee-eaa1-4ba7-a1f1-887e8e767e46 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:14.038317 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-264175ee-eaa1-4ba7-a1f1-887e8e767e46 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.30 "GET /v2.0/networks?id=fc9aa7d4-2600-448e-b2e4-9004cbcee079 HTTP/1.1" status: 200  len: 811 time: 0.5830853
Jun 01 10:06:14.107401 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:14.199508 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:14.422099 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [req-82580940-9021-41ce-a04d-18275a28fca8 req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Request body: {'port': {'device_id': '2abcfd9c-55d9-46ea-8a25-6a89998bf874', 'network_id': 'fc9aa7d4-2600-448e-b2e4-9004cbcee079', 'admin_state_up': True, 'tenant_id': '17dcefd313724cf2abaacb81a9e0729c'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:14.670223 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 9ae36a44-2229-48a5-8955-f44cea3ffab0, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=9ae36a44-2229-48a5-8955-f44cea3ffab0,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:14.758632 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Notify callbacks [] for port, precommit_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:14.813586 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Transition to ACTIVE for port object d943f1f4-e253-47b0-93f0-2e7e1f117536 will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:14.814328 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe726a0400>, [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:10Z', 'revision_number': 4, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71', 'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'mac_address': 'fa:16:3e:a9:83:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:10Z', 'revision_number': 2, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'subnets': [{'id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:14.819442 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Checking router: d0653611-f9db-4b67-b4b2-4c0789fb691f for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:06:14.820042 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Updating router d0653611-f9db-4b67-b4b2-4c0789fb691f port 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 binding host dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:06:14.837279 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:14.871418 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:14.880835 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:15.019357 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:15.037675 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device a0439258-ab2e-431a-bcd9-3f137ae4d80a up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:15.083786 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [req-82580940-9021-41ce-a04d-18275a28fca8 req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:15.093723 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-82580940-9021-41ce-a04d-18275a28fca8 req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Usage tracker for resource:port and tenant:17dcefd313724cf2abaacb81a9e0729c is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:15.100936 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-82580940-9021-41ce-a04d-18275a28fca8 req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:15.111938 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [req-82580940-9021-41ce-a04d-18275a28fca8 req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:15.118604 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:15.128452 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Set router d65374d4-451b-4890-a2f5-a4bcac5a9a38 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:06:15.331741 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-77f358ea-f9bb-43fe-bf82-1b86e9751020 req-bd642f80-5d11-431b-8910-ca0aec2cf755 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 210 time: 0.1768591
Jun 01 10:06:15.525325 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-82580940-9021-41ce-a04d-18275a28fca8 req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Made reservation on behalf of 17dcefd313724cf2abaacb81a9e0729c for: {'port': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:06:15.545182 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-82580940-9021-41ce-a04d-18275a28fca8 req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:15.700660 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 57050) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:15.706448 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 57058) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:15.706448 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 57056) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:15.714494 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-82bfea5a-3914-4ecb-8fe1-c3f08d465fa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1278143630', 'description': 'tempest-description--292399806'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:15.729235 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-82bfea5a-3914-4ecb-8fe1-c3f08d465fa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:15.732917 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Attempting to bind port d943f1f4-e253-47b0-93f0-2e7e1f117536 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:06:15.737812 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Attempting to bind port d943f1f4-e253-47b0-93f0-2e7e1f117536 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:06:15.737812 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Attempting to bind port d943f1f4-e253-47b0-93f0-2e7e1f117536 on network a961b732-0873-4e86-af5a-7e84ae1a2549 {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:15.740805 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-82bfea5a-3914-4ecb-8fe1-c3f08d465fa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Usage tracker for resource:security_group and tenant:d13dc1de700d428a8982ca87f11948d0 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:15.747041 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-82bfea5a-3914-4ecb-8fe1-c3f08d465fa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:15.752812 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-82bfea5a-3914-4ecb-8fe1-c3f08d465fa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:15.753688 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 6, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:06:15.754066 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Checking segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:06:15.754473 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:15.755725 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Bound using segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:06:15.760875 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Bound port: d943f1f4-e253-47b0-93f0-2e7e1f117536, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:06:15.760875 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:15.765012 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:15.777891 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Notify callbacks [] for port, precommit_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:15.813756 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.provisioning_blocks [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Transition to ACTIVE for port object 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 will not be triggered until provisioned by entity L2. {{(pid=92568) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:15.896524 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] For port d943f1f4-e253-47b0-93f0-2e7e1f117536, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:06:15.898073 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-82bfea5a-3914-4ecb-8fe1-c3f08d465fa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:15.901468 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] For port d943f1f4-e253-47b0-93f0-2e7e1f117536, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=d943f1f4-e253-47b0-93f0-2e7e1f117536,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:06:15.902584 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port a0439258-ab2e-431a-bcd9-3f137ae4d80a triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:15.902990 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:15.916487 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:15.933100 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-e9e829e2-a0f2-4f56-9e56-ae7c28d374d6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:16.063545 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=9ae36a44-2229-48a5-8955-f44cea3ffab0,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:16.078487 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:16.089658 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.230s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:16.093080 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.881s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:16.162148 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [req-82580940-9021-41ce-a04d-18275a28fca8 req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Allocated IP 172.20.0.3 (fc9aa7d4-2600-448e-b2e4-9004cbcee079/acb0c106-1f4c-4cf1-9985-fb4e642b58bb/1f8c5c86-a9a1-4720-821c-f7e5d5c18184) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:06:16.166051 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:16.173235 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7873030', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-401824'] for router_interface, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:16.194178 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:16.194291 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:16.228296 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18d101de-b869-4104-bf85-9b451a2e6a1b None None] Pushing event updated for resources: {'Port': ['ID=7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71,revision_number=3']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:16.243418 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36a7db33-a748-4db9-aea5-0991ee90be02 None None] Pushing event updated for resources: {'Port': ['ID=d943f1f4-e253-47b0-93f0-2e7e1f117536,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:16.253294 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-18d101de-b869-4104-bf85-9b451a2e6a1b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.320s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:16.266612 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:16.288082 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-36a7db33-a748-4db9-aea5-0991ee90be02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:16.312057 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.046s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:16.424093 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36a7db33-a748-4db9-aea5-0991ee90be02 None None] Pushing event updated for resources: {'Port': ['ID=d943f1f4-e253-47b0-93f0-2e7e1f117536,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:16.441037 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-36a7db33-a748-4db9-aea5-0991ee90be02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:16.477872 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:06:16.491927 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Attempting to bind port 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:06:16.496180 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Attempting to bind port 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '2f350557-5423-4a12-a64b-0bf55f2578e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc'}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:06:16.496456 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Attempting to bind port 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 on network 3d9ff4d3-b145-4108-a593-976a9cfb63dc {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:16.504017 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Allocated IP 172.20.0.1 (be546533-cf92-483d-9e38-7d14ca9c4902/f2fdda64-a03c-41d7-8178-daca0363bd6e/476d2473-d40f-4cca-8a85-8b1ea30a5281) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:06:16.508493 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 6, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:06:16.509303 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Checking segment: {'id': '2f350557-5423-4a12-a64b-0bf55f2578e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92568) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:06:16.510421 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:16.512383 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Bound using segment: {'id': '2f350557-5423-4a12-a64b-0bf55f2578e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc'} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:06:16.512989 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Bound port: 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2f350557-5423-4a12-a64b-0bf55f2578e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc'}}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:06:16.515043 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:16.818543 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-82bfea5a-3914-4ecb-8fe1-c3f08d465fa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:16.822728 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Routers {'369d44f0-4eb2-4ec0-94e5-1562c07efd26'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:06:16.822728 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72698100>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:06:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['369d44f0-4eb2-4ec0-94e5-1562c07efd26'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:16.823626 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] For port 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92568) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:06:16.823626 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] For port 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71,segment=NetworkSegment(2f350557-5423-4a12-a64b-0bf55f2578e6),segment_id=2f350557-5423-4a12-a64b-0bf55f2578e6)] {{(pid=92568) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:06:16.824473 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Network 34268ce8-8baf-41d5-acbc-1b6c167dd481 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:16.840228 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:16.861612 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Pushing event updated for resources: {'Port': ['ID=2313fd35-8139-4639-b9e5-bd9fc71943ca,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:16.870958 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-82bfea5a-3914-4ecb-8fe1-c3f08d465fa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Usage tracker for resource:security_group_rule and tenant:d13dc1de700d428a8982ca87f11948d0 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:16.877648 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-82bfea5a-3914-4ecb-8fe1-c3f08d465fa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:16.952412 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.759s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:16.973901 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:16.981301 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:17.092890 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 9ae36a44-2229-48a5-8955-f44cea3ffab0 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:17.215895 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:17.269262 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Transition to ACTIVE for port object 476d2473-d40f-4cca-8a85-8b1ea30a5281 will not be triggered until provisioned by entity DHCP. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:17.320925 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] Set router 369d44f0-4eb2-4ec0-94e5-1562c07efd26 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:06:17.337522 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-82bfea5a-3914-4ecb-8fe1-c3f08d465fa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:17.345491 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Routers {'d0653611-f9db-4b67-b4b2-4c0789fb691f'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:06:17.346442 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe726a0400>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:06:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d0653611-f9db-4b67-b4b2-4c0789fb691f'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:17.601489 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-82bfea5a-3914-4ecb-8fe1-c3f08d465fa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:17.604231 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-efcd9104-c632-4058-a1a9-34ae7c447b59 req-63e09d6f-4598-4cce-bf23-2320dbd8573d tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 210 time: 0.9386597
Jun 01 10:06:17.608013 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:17.610053 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-23232c91-f303-47d3-9e5d-1e0a98f4ef21 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:17.634057 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-23232c91-f303-47d3-9e5d-1e0a98f4ef21 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:17.639009 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-23232c91-f303-47d3-9e5d-1e0a98f4ef21 admin admin] Usage tracker for resource:security_group_rule and tenant:e3918a75060340aea1cbd95972e56aa7 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:17.643428 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-23232c91-f303-47d3-9e5d-1e0a98f4ef21 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:17.651339 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-23232c91-f303-47d3-9e5d-1e0a98f4ef21 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:17.657243 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-bb6cc97e-e321-4161-806a-14abf2cad93d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:17.684625 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:17.709053 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 9ae36a44-2229-48a5-8955-f44cea3ffab0 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:17.709640 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:17.726029 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-82580940-9021-41ce-a04d-18275a28fca8 req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:17.788060 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18d101de-b869-4104-bf85-9b451a2e6a1b None None] Pushing event updated for resources: {'Port': ['ID=7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71,revision_number=4']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:17.798282 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Router 369d44f0-4eb2-4ec0-94e5-1562c07efd26 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:06:17.811188 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-18d101de-b869-4104-bf85-9b451a2e6a1b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.830s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:17.903847 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Network be546533-cf92-483d-9e38-7d14ca9c4902 is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:17.909894 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-82bfea5a-3914-4ecb-8fe1-c3f08d465fa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:17.932374 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:17.939621 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:06:17.943631 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-401677'] for router_interface, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:17.986017 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] Set router d0653611-f9db-4b67-b4b2-4c0789fb691f gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:06:18.029350 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-bb6cc97e-e321-4161-806a-14abf2cad93d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:18.038757 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72759490>, [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:10Z', 'revision_number': 3, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:18.106249 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-bb6cc97e-e321-4161-806a-14abf2cad93d admin admin] Usage tracker for resource:security_group_rule and tenant:5a3a5f8c2ec54a9a9c4200913a977010 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:18.141329 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-bb6cc97e-e321-4161-806a-14abf2cad93d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:18.184574 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-bb6cc97e-e321-4161-806a-14abf2cad93d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:18.240977 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Checking router: d65374d4-451b-4890-a2f5-a4bcac5a9a38 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:06:18.241338 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Updating router d65374d4-451b-4890-a2f5-a4bcac5a9a38 port 5a1ced49-9531-4fcc-b7ac-004241b95c6b binding host dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:06:18.251082 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Pushing event updated for resources: {'Port': ['ID=476d2473-d40f-4cca-8a85-8b1ea30a5281,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:18.290697 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.606s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:18.293304 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6d52a0df-d388-4b79-ae76-f17f45597364 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.160s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:18.380356 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-23232c91-f303-47d3-9e5d-1e0a98f4ef21 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:18.459106 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-82bfea5a-3914-4ecb-8fe1-c3f08d465fa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:18.466164 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 57110) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:18.468196 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-82bfea5a-3914-4ecb-8fe1-c3f08d465fa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1777 time: 2.7643571
Jun 01 10:06:18.480720 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-f9242fb0-79d7-4aa2-9034-90391b7c6f7f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Request body: {'security_group_rule': {'security_group_id': 'ef889387-b500-43ef-a425-6324661f46cb', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:18.483572 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82bfea5a-3914-4ecb-8fe1-c3f08d465fa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ef889387-b500-43ef-a425-6324661f46cb,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:18.497405 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-82bfea5a-3914-4ecb-8fe1-c3f08d465fa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:18.498502 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-f9242fb0-79d7-4aa2-9034-90391b7c6f7f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:18.514047 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f9242fb0-79d7-4aa2-9034-90391b7c6f7f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Usage tracker for resource:security_group_rule and tenant:d13dc1de700d428a8982ca87f11948d0 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:18.533689 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:18.537212 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f9242fb0-79d7-4aa2-9034-90391b7c6f7f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:18.540402 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-23232c91-f303-47d3-9e5d-1e0a98f4ef21 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:18.562780 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-82580940-9021-41ce-a04d-18275a28fca8 req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:18.573777 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-d64b030d-35ae-4acc-ae2b-077769a05a9a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:18.599494 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:06:18.630830 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-f9242fb0-79d7-4aa2-9034-90391b7c6f7f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:18.651880 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-fb5b1eb1-bbd2-41e3-bcc8-df63cc7c4a54 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:18.695012 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-23232c91-f303-47d3-9e5d-1e0a98f4ef21 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=e3918a75060340aea1cbd95972e56aa7&name=default HTTP/1.1" status: 200  len: 2975 time: 2.9897718
Jun 01 10:06:18.734392 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 57120) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:18.808672 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Pushing event updated for resources: {'Port': ['ID=1f8c5c86-a9a1-4720-821c-f7e5d5c18184,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:18.817690 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:18.846767 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-82580940-9021-41ce-a04d-18275a28fca8 req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Network fc9aa7d4-2600-448e-b2e4-9004cbcee079 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:18.860852 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [req-82580940-9021-41ce-a04d-18275a28fca8 req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:18.878954 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] 10.222.0.68 "PUT /v2.0/routers/369d44f0-4eb2-4ec0-94e5-1562c07efd26/add_router_interface HTTP/1.1" status: 200  len: 503 time: 7.6204381
Jun 01 10:06:18.880023 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [req-82580940-9021-41ce-a04d-18275a28fca8 req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:06:18.895155 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82580940-9021-41ce-a04d-18275a28fca8 req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:18.898936 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-82580940-9021-41ce-a04d-18275a28fca8 req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:18.923456 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:18.942048 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-5df7f6db-c377-455a-ac7a-70fca7cf83d6 None None] Provisioning for port 476d2473-d40f-4cca-8a85-8b1ea30a5281 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:18.945360 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f9242fb0-79d7-4aa2-9034-90391b7c6f7f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:19.015593 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-5df7f6db-c377-455a-ac7a-70fca7cf83d6 None None] Provisioning complete for port 476d2473-d40f-4cca-8a85-8b1ea30a5281 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:19.016091 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-5df7f6db-c377-455a-ac7a-70fca7cf83d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:19.068298 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe726a0400>, [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:10Z', 'revision_number': 4, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71', 'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'mac_address': 'fa:16:3e:a9:83:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:16Z', 'revision_number': 4, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'subnets': [{'id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:19.073375 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cd5f10d-c409-4cf8-aa0e-cfd3b6faff49 None None] The sync data for ids ['d0653611-f9db-4b67-b4b2-4c0789fb691f'] in dv-cinder-787262-4-iscsi is: [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:10Z', 'revision_number': 4, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71', 'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'mac_address': 'fa:16:3e:a9:83:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:16Z', 'revision_number': 4, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'subnets': [{'id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:06:19.105018 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-5df7f6db-c377-455a-ac7a-70fca7cf83d6 None None] Port 476d2473-d40f-4cca-8a85-8b1ea30a5281 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:06:19.124843 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23232c91-f303-47d3-9e5d-1e0a98f4ef21 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1c2524c-176f-4700-b57e-4d3306b2d1cb,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:19.129040 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-23232c91-f303-47d3-9e5d-1e0a98f4ef21 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.556s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:19.424122 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 5.2088392
Jun 01 10:06:19.489290 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-095c2dd4-13e3-4206-9e50-96c939319287 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] http://10.222.0.68:9696/v2.0/extensions returned with HTTP 200 {{(pid=92565) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 10:06:19.496659 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-095c2dd4-13e3-4206-9e50-96c939319287 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0345752
Jun 01 10:06:19.499012 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f9242fb0-79d7-4aa2-9034-90391b7c6f7f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:19.502755 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72698100>, [{'id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'name': 'tempest-ServerRescueNegativeTestJSON-1852296292-router', 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.219'}], 'enable_snat': True}, 'gw_port_id': 'd943f1f4-e253-47b0-93f0-2e7e1f117536', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:14Z', 'revision_number': 4, 'project_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'gw_port': {'id': 'd943f1f4-e253-47b0-93f0-2e7e1f117536', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:8b:9a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '2313fd35-8139-4639-b9e5-bd9fc71943ca', 'name': '', 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481', 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'mac_address': 'fa:16:3e:3d:00:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'device_owner': 'network:router_interface', 'standard_attr_id': 87, 'fixed_ips': [{'subnet_id': '2ee54c26-f286-4f9a-b791-24aa84feb26a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:12Z', 'updated_at': '2021-06-01T10:06:15Z', 'revision_number': 2, 'project_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'subnets': [{'id': '2ee54c26-f286-4f9a-b791-24aa84feb26a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:19.519057 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-bb6cc97e-e321-4161-806a-14abf2cad93d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:19.555714 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e719c553-4cb1-4f9f-82fb-594b0f07fb01 None None] The sync data for ids ['369d44f0-4eb2-4ec0-94e5-1562c07efd26'] in dv-cinder-787262-4-iscsi is: [{'id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'name': 'tempest-ServerRescueNegativeTestJSON-1852296292-router', 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.219'}], 'enable_snat': True}, 'gw_port_id': 'd943f1f4-e253-47b0-93f0-2e7e1f117536', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:14Z', 'revision_number': 4, 'project_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'gw_port': {'id': 'd943f1f4-e253-47b0-93f0-2e7e1f117536', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:8b:9a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '2313fd35-8139-4639-b9e5-bd9fc71943ca', 'name': '', 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481', 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'mac_address': 'fa:16:3e:3d:00:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'device_owner': 'network:router_interface', 'standard_attr_id': 87, 'fixed_ips': [{'subnet_id': '2ee54c26-f286-4f9a-b791-24aa84feb26a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:12Z', 'updated_at': '2021-06-01T10:06:15Z', 'revision_number': 2, 'project_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'subnets': [{'id': '2ee54c26-f286-4f9a-b791-24aa84feb26a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:06:19.596784 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f9242fb0-79d7-4aa2-9034-90391b7c6f7f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:19.607517 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:19.642882 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9242fb0-79d7-4aa2-9034-90391b7c6f7f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=021fd46f-02cc-472a-a56c-cba39e24a086,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:19.646859 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f9242fb0-79d7-4aa2-9034-90391b7c6f7f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:19.681178 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-bb6cc97e-e321-4161-806a-14abf2cad93d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:19.727832 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f9242fb0-79d7-4aa2-9034-90391b7c6f7f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:19.729465 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-f9242fb0-79d7-4aa2-9034-90391b7c6f7f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 1.2616494
Jun 01 10:06:19.732978 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 57146) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:19.742404 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-c1cc3990-e98d-48aa-a467-52a9e3cc1c9e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Request body: {'security_group_rule': {'security_group_id': 'ef889387-b500-43ef-a425-6324661f46cb', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:19.767340 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-c1cc3990-e98d-48aa-a467-52a9e3cc1c9e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:19.783002 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-c1cc3990-e98d-48aa-a467-52a9e3cc1c9e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Usage tracker for resource:security_group_rule and tenant:d13dc1de700d428a8982ca87f11948d0 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:19.793451 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-c1cc3990-e98d-48aa-a467-52a9e3cc1c9e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:19.816097 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-c1cc3990-e98d-48aa-a467-52a9e3cc1c9e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:19.853364 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Notify callbacks [] for port, precommit_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:19.895489 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Transition to ACTIVE for port object 5a1ced49-9531-4fcc-b7ac-004241b95c6b will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:19.903057 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:19.943423 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c1cc3990-e98d-48aa-a467-52a9e3cc1c9e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:19.962359 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:19.981602 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:20.001643 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ba48e32d-67a0-4bf7-8fbb-e9aac2dde223 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:20.066520 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c1cc3990-e98d-48aa-a467-52a9e3cc1c9e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:20.173267 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c1cc3990-e98d-48aa-a467-52a9e3cc1c9e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:20.225691 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f9242fb0-79d7-4aa2-9034-90391b7c6f7f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:20.262984 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2527f620-2fea-4095-b430-2888995edd8d None None] Pushing event updated for resources: {'Port': ['ID=5a1ced49-9531-4fcc-b7ac-004241b95c6b,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:20.272985 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1cc3990-e98d-48aa-a467-52a9e3cc1c9e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=239d3d80-2f42-4dc2-8195-b203682adc91,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:20.288691 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c1cc3990-e98d-48aa-a467-52a9e3cc1c9e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:20.297999 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 57170) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:20.321465 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c1cc3990-e98d-48aa-a467-52a9e3cc1c9e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:20.321465 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-c1cc3990-e98d-48aa-a467-52a9e3cc1c9e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.5841801
Jun 01 10:06:20.328589 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Attempting to bind port 5a1ced49-9531-4fcc-b7ac-004241b95c6b on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:06:20.329127 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Attempting to bind port 5a1ced49-9531-4fcc-b7ac-004241b95c6b by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:06:20.329624 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Attempting to bind port 5a1ced49-9531-4fcc-b7ac-004241b95c6b on network a961b732-0873-4e86-af5a-7e84ae1a2549 {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:20.330785 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 57176) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:20.333772 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-2527f620-2fea-4095-b430-2888995edd8d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.352s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:20.343907 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 6, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:06:20.344679 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Checking segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:06:20.345338 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:20.346037 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Request body: {'floatingip': {'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:20.346418 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Bound using segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:06:20.351473 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Bound port: 5a1ced49-9531-4fcc-b7ac-004241b95c6b, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:06:20.352210 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:20.373745 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:20.395001 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Usage tracker for resource:floatingip and tenant:d13dc1de700d428a8982ca87f11948d0 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:20.407950 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:20.434810 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:20.517124 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] For port 5a1ced49-9531-4fcc-b7ac-004241b95c6b, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:06:20.524459 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] For port 5a1ced49-9531-4fcc-b7ac-004241b95c6b, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=5a1ced49-9531-4fcc-b7ac-004241b95c6b,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:06:20.530826 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-b94ead59-9165-49c9-a51b-001a19766d91 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:20.531600 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-b94ead59-9165-49c9-a51b-001a19766d91 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Synchronizing usage tracker for tenant:ef4bc75ba53a44cca2e4b7c2b8aeb818 on resource:network {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:06:20.539219 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for floatingip, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:20.607988 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:20.630210 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-2527f620-2fea-4095-b430-2888995edd8d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:20.654661 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb6cc97e-e321-4161-806a-14abf2cad93d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3de89288-2986-4038-864e-bbc869741ce3,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:20.697553 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-bb6cc97e-e321-4161-806a-14abf2cad93d admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=5a3a5f8c2ec54a9a9c4200913a977010&name=default HTTP/1.1" status: 200  len: 2978 time: 4.9951673
Jun 01 10:06:20.745313 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-bb6cc97e-e321-4161-806a-14abf2cad93d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.844s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:20.778838 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 57182) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:20.823393 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:20.870549 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a10c2a83-f9db-4aab-9c97-ae09d9c66fc3 req-3565c83e-1e05-41df-9ed2-077b910586b1 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:20.883100 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a10c2a83-f9db-4aab-9c97-ae09d9c66fc3 req-3565c83e-1e05-41df-9ed2-077b910586b1 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 931 time: 1.8752429
Jun 01 10:06:20.885324 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ba48e32d-67a0-4bf7-8fbb-e9aac2dde223 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:20.893971 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Request body: {'port': {'device_id': '2abcfd9c-55d9-46ea-8a25-6a89998bf874', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:20.956457 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:20.978137 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7873030', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-401824'] for router_interface, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:20.984553 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Routers {'d65374d4-451b-4890-a2f5-a4bcac5a9a38'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:06:20.988450 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72759490>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:06:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:20.988990 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-b94ead59-9165-49c9-a51b-001a19766d91 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Unset dirty status for tenant:ef4bc75ba53a44cca2e4b7c2b8aeb818 on resource:network {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:06:20.990260 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-b94ead59-9165-49c9-a51b-001a19766d91 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/networks?id=34268ce8-8baf-41d5-acbc-1b6c167dd481 HTTP/1.1" status: 200  len: 819 time: 0.9579935
Jun 01 10:06:21.011871 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:21.033685 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5c478f01-04c3-49a0-ada1-c87380868238 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:21.118225 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2527f620-2fea-4095-b430-2888995edd8d None None] Pushing event updated for resources: {'Port': ['ID=5a1ced49-9531-4fcc-b7ac-004241b95c6b,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:21.127134 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-2527f620-2fea-4095-b430-2888995edd8d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.507s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:21.135476 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-5c478f01-04c3-49a0-ada1-c87380868238 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:21.146004 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Pushing event updated for resources: {'Port': ['ID=476d2473-d40f-4cca-8a85-8b1ea30a5281,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:21.172145 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:21.179600 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-5c478f01-04c3-49a0-ada1-c87380868238 admin admin] Usage tracker for resource:security_group_rule and tenant:2b7ba301b5b04e358b50c0d03baf7931 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:21.190037 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-6c3c39cc-41e9-49f6-a5a4-51dae481a033 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/quotas/ef4bc75ba53a44cca2e4b7c2b8aeb818 HTTP/1.1" status: 200  len: 375 time: 0.0476065
Jun 01 10:06:21.218238 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-5c478f01-04c3-49a0-ada1-c87380868238 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:21.243781 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-5c478f01-04c3-49a0-ada1-c87380868238 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:21.485318 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ee6a73e5-1d7e-43ce-a8f2-136ae92947f8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:21.496108 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device d943f1f4-e253-47b0-93f0-2e7e1f117536 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:21.527747 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-a10c2a83-f9db-4aab-9c97-ae09d9c66fc3 req-f52a13d9-9e62-48a0-8229-f3eb4a64a176 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Synchronizing usage tracker for tenant:17dcefd313724cf2abaacb81a9e0729c on resource:security_group {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:06:21.542609 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Network be546533-cf92-483d-9e38-7d14ca9c4902 is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:21.559108 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:21.569353 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:21.675877 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] Set router d65374d4-451b-4890-a2f5-a4bcac5a9a38 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:06:21.752200 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ee6a73e5-1d7e-43ce-a8f2-136ae92947f8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:21.935655 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:21.942683 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port d943f1f4-e253-47b0-93f0-2e7e1f117536 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:22.029898 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-a5d2d33b-aa55-453e-876c-4fca0cbdfef8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=ef4bc75ba53a44cca2e4b7c2b8aeb818&fields=id HTTP/1.1" status: 200  len: 255 time: 0.5962255
Jun 01 10:06:22.033256 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port d943f1f4-e253-47b0-93f0-2e7e1f117536 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:22.033695 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:22.111596 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Router d65374d4-451b-4890-a2f5-a4bcac5a9a38 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92566) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:06:22.120671 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ba48e32d-67a0-4bf7-8fbb-e9aac2dde223 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:22.368649 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:22.368844 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Allocated IP 172.27.2.97 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/2a5e6d0f-fcce-4d41-a102-68d2d2a33315) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:06:22.384322 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-a904ae7d-a568-4035-843f-df354dfe0041 None None] Provisioning complete for port 476d2473-d40f-4cca-8a85-8b1ea30a5281 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:22.385404 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-a904ae7d-a568-4035-843f-df354dfe0041 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:22.404873 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba48e32d-67a0-4bf7-8fbb-e9aac2dde223 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1c2524c-176f-4700-b57e-4d3306b2d1cb,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:22.417901 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-ba48e32d-67a0-4bf7-8fbb-e9aac2dde223 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:22.500868 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-a904ae7d-a568-4035-843f-df354dfe0041 None None] Port 476d2473-d40f-4cca-8a85-8b1ea30a5281 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:06:22.529987 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ba48e32d-67a0-4bf7-8fbb-e9aac2dde223 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:22.531394 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-ba48e32d-67a0-4bf7-8fbb-e9aac2dde223 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/b1c2524c-176f-4700-b57e-4d3306b2d1cb HTTP/1.1" status: 204  len: 168 time: 3.7029624
Jun 01 10:06:22.557991 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5c478f01-04c3-49a0-ada1-c87380868238 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:22.631914 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:22.641821 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-9f9e3a26-095b-48ff-ae0d-4b31b7dff163 service neutron] 10.222.0.68 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.6020958
Jun 01 10:06:22.719497 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port d943f1f4-e253-47b0-93f0-2e7e1f117536, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=d943f1f4-e253-47b0-93f0-2e7e1f117536,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:22.745420 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-a10c2a83-f9db-4aab-9c97-ae09d9c66fc3 req-f52a13d9-9e62-48a0-8229-f3eb4a64a176 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Unset dirty status for tenant:17dcefd313724cf2abaacb81a9e0729c on resource:security_group {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:06:22.755507 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a10c2a83-f9db-4aab-9c97-ae09d9c66fc3 req-f52a13d9-9e62-48a0-8229-f3eb4a64a176 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 1.8551412
Jun 01 10:06:22.818522 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72759490>, [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:18Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '476d2473-d40f-4cca-8a85-8b1ea30a5281', 'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'mac_address': 'fa:16:3e:87:a6:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:15Z', 'updated_at': '2021-06-01T10:06:19Z', 'revision_number': 2, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'subnets': [{'id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:22.821690 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5c478f01-04c3-49a0-ada1-c87380868238 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:22.825134 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-730c23ec-4d95-479c-91f1-52bc9ea36154 None None] The sync data for ids ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'] in dv-cinder-787262-4-iscsi is: [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:18Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '476d2473-d40f-4cca-8a85-8b1ea30a5281', 'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'mac_address': 'fa:16:3e:87:a6:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:15Z', 'updated_at': '2021-06-01T10:06:19Z', 'revision_number': 2, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'subnets': [{'id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:06:22.831278 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:22.834071 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:22.841727 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:22.885337 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-77fa8565-d48b-4a0c-bf93-0dffc3aa2e1b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:22.892322 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:06:22.919540 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] 10.222.0.68 "PUT /v2.0/routers/d65374d4-451b-4890-a2f5-a4bcac5a9a38/add_router_interface HTTP/1.1" status: 200  len: 503 time: 9.2376869
Jun 01 10:06:22.983903 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-5c478f01-04c3-49a0-ada1-c87380868238 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=2b7ba301b5b04e358b50c0d03baf7931&name=default HTTP/1.1" status: 200  len: 2979 time: 2.6847177
Jun 01 10:06:22.995918 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 57200) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:23.015696 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:23.079472 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=d943f1f4-e253-47b0-93f0-2e7e1f117536,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:23.094692 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:23.177516 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:23.184390 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:23.185210 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:23.194076 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-3aeb64ff-e124-4e71-a832-42f62aabfbfd service neutron] 10.222.0.68 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5513532
Jun 01 10:06:23.215510 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ee6a73e5-1d7e-43ce-a8f2-136ae92947f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:23.220732 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c478f01-04c3-49a0-ada1-c87380868238 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=11e26aaf-fc36-4dff-a25d-d2f05719c3e7,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:23.240121 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-621f6dbe-f8a8-4f18-851b-aed762ec9f13 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:23.258852 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-5c478f01-04c3-49a0-ada1-c87380868238 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.417s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:23.259601 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-5c478f01-04c3-49a0-ada1-c87380868238 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:23.284415 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee6a73e5-1d7e-43ce-a8f2-136ae92947f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3de89288-2986-4038-864e-bbc869741ce3,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:23.290278 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-ee6a73e5-1d7e-43ce-a8f2-136ae92947f8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:23.329381 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-621f6dbe-f8a8-4f18-851b-aed762ec9f13 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:23.560192 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ee6a73e5-1d7e-43ce-a8f2-136ae92947f8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:23.564047 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-ee6a73e5-1d7e-43ce-a8f2-136ae92947f8 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/3de89288-2986-4038-864e-bbc869741ce3 HTTP/1.1" status: 204  len: 168 time: 2.7692006
Jun 01 10:06:23.589697 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 57214) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:23.679096 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-621f6dbe-f8a8-4f18-851b-aed762ec9f13 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:23.710726 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-e81ed1f6-bc36-420f-a52a-b877900fe095 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:23.732130 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:23.748775 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:23.798989 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-bb6cc97e-e321-4161-806a-14abf2cad93d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.008s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:23.859838 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-621f6dbe-f8a8-4f18-851b-aed762ec9f13 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=11e26aaf-fc36-4dff-a25d-d2f05719c3e7,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:23.882523 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-621f6dbe-f8a8-4f18-851b-aed762ec9f13 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:23.889741 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Sync routers for ids ['369d44f0-4eb2-4ec0-94e5-1562c07efd26'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:06:23.903615 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Routers {'369d44f0-4eb2-4ec0-94e5-1562c07efd26'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:06:23.905693 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-621f6dbe-f8a8-4f18-851b-aed762ec9f13 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:23.917089 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71,segment=NetworkSegment(2f350557-5423-4a12-a64b-0bf55f2578e6),segment_id=2f350557-5423-4a12-a64b-0bf55f2578e6)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:23.918531 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-621f6dbe-f8a8-4f18-851b-aed762ec9f13 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/11e26aaf-fc36-4dff-a25d-d2f05719c3e7 HTTP/1.1" status: 204  len: 168 time: 0.9198921
Jun 01 10:06:23.934891 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7273fbb0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:06:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['369d44f0-4eb2-4ec0-94e5-1562c07efd26'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:23.940520 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-e81ed1f6-bc36-420f-a52a-b877900fe095 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:23.956045 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-e81ed1f6-bc36-420f-a52a-b877900fe095 admin admin] Usage tracker for resource:security_group_rule and tenant:e8351f9a204745e9bac21b503a1da72e is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:23.960205 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-e81ed1f6-bc36-420f-a52a-b877900fe095 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:23.974739 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-e81ed1f6-bc36-420f-a52a-b877900fe095 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:23.996828 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:23.998780 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-36a7db33-a748-4db9-aea5-0991ee90be02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:24.009651 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:24.171454 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:24.185453 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:24.190969 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device d943f1f4-e253-47b0-93f0-2e7e1f117536 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:24.217460 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 {{(pid=92565) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:06:24.240160 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:24.246151 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-e81ed1f6-bc36-420f-a52a-b877900fe095 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:24.283393 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.provisioning_blocks [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Transition to ACTIVE for port object 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 will not be triggered until provisioned by entity L2. {{(pid=92565) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:24.351100 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:24.362811 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:24.369914 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:06:24.420046 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9306f7f1-3aa0-4942-bac4-4ab4690bf86e req-198ab23e-5390-4063-babd-2e75e0cbe18e tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 210 time: 0.5569234
Jun 01 10:06:24.423821 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-e81ed1f6-bc36-420f-a52a-b877900fe095 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:24.579065 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:24.602840 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Set router 369d44f0-4eb2-4ec0-94e5-1562c07efd26 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:06:24.630941 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port d943f1f4-e253-47b0-93f0-2e7e1f117536 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:24.631534 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:24.661783 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-e81ed1f6-bc36-420f-a52a-b877900fe095 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=e8351f9a204745e9bac21b503a1da72e&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0707064
Jun 01 10:06:24.662552 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:24.664810 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 57246) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:24.669651 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e81ed1f6-bc36-420f-a52a-b877900fe095 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=75a25fc7-99b1-4a28-bfdf-8fe172f15152,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:24.679978 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event updated for resources: {'Port': ['ID=2a5e6d0f-fcce-4d41-a102-68d2d2a33315,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:24.693053 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.689s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:24.694612 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.017s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:24.712273 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-e81ed1f6-bc36-420f-a52a-b877900fe095 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:24.969462 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b1547fab-727a-47ce-b5c5-9294dc4e52f2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:25.168795 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b1547fab-727a-47ce-b5c5-9294dc4e52f2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:25.266406 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-443b6614-a671-46ec-afef-b5c4ad44b45f req-b0895a4b-40ae-4328-a36d-84df7107047a tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:25.278480 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-443b6614-a671-46ec-afef-b5c4ad44b45f req-b0895a4b-40ae-4328-a36d-84df7107047a tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 943 time: 0.3100679
Jun 01 10:06:25.376409 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-443b6614-a671-46ec-afef-b5c4ad44b45f req-d77e58bf-6b97-4bbf-bda4-b71bcf7b3ab8 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0968754
Jun 01 10:06:25.446010 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:25.566039 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Pushing event updated for resources: {'Port': ['ID=1f8c5c86-a9a1-4720-821c-f7e5d5c18184,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:25.571443 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 57272) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:25.583814 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-6cfac790-a934-40c5-83a7-c7ee16df58e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Request body: {'security_group': {'name': 'tempest-securitygroup--2133036691', 'description': 'tempest-description--1409629602'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:25.594542 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.900s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:25.599272 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6cfac790-a934-40c5-83a7-c7ee16df58e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:25.604831 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6cfac790-a934-40c5-83a7-c7ee16df58e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Usage tracker for resource:security_group and tenant:f4f6f875519045a39c1fdbadd53ce517 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:25.622573 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Attempting to bind port 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:06:25.624497 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6cfac790-a934-40c5-83a7-c7ee16df58e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:25.628194 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Attempting to bind port 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': 'db85cbc8-d6a7-4b73-b511-b419c581a2fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'fc9aa7d4-2600-448e-b2e4-9004cbcee079'}] {{(pid=92565) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:06:25.628948 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Attempting to bind port 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 on network fc9aa7d4-2600-448e-b2e4-9004cbcee079 {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:25.638479 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6cfac790-a934-40c5-83a7-c7ee16df58e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:25.666080 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b1547fab-727a-47ce-b5c5-9294dc4e52f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:25.748247 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-e81ed1f6-bc36-420f-a52a-b877900fe095 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:25.815756 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7273fbb0>, [{'id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'name': 'tempest-ServerRescueNegativeTestJSON-1852296292-router', 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.219'}], 'enable_snat': True}, 'gw_port_id': 'd943f1f4-e253-47b0-93f0-2e7e1f117536', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:14Z', 'revision_number': 4, 'project_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'gw_port': {'id': 'd943f1f4-e253-47b0-93f0-2e7e1f117536', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:8b:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '2313fd35-8139-4639-b9e5-bd9fc71943ca', 'name': '', 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481', 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'mac_address': 'fa:16:3e:3d:00:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'device_owner': 'network:router_interface', 'standard_attr_id': 87, 'fixed_ips': [{'subnet_id': '2ee54c26-f286-4f9a-b791-24aa84feb26a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:12Z', 'updated_at': '2021-06-01T10:06:15Z', 'revision_number': 2, 'project_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'subnets': [{'id': '2ee54c26-f286-4f9a-b791-24aa84feb26a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:25.821486 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Checking router: 369d44f0-4eb2-4ec0-94e5-1562c07efd26 for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:06:25.821964 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Updating router 369d44f0-4eb2-4ec0-94e5-1562c07efd26 port 2313fd35-8139-4639-b9e5-bd9fc71943ca binding host dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:06:25.843101 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6cfac790-a934-40c5-83a7-c7ee16df58e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:25.845096 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Port 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 on network fc9aa7d4-2600-448e-b2e4-9004cbcee079 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:06:25.845682 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Attempting to bind port 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 on network fc9aa7d4-2600-448e-b2e4-9004cbcee079 {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:25.858726 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 5, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:06:25.860018 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Checking segment: {'id': 'db85cbc8-d6a7-4b73-b511-b419c581a2fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'fc9aa7d4-2600-448e-b2e4-9004cbcee079'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92565) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:06:25.861028 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Bound using segment: {'id': 'db85cbc8-d6a7-4b73-b511-b419c581a2fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'fc9aa7d4-2600-448e-b2e4-9004cbcee079'} {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:06:25.862038 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Bound port: 1f8c5c86-a9a1-4720-821c-f7e5d5c18184, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'db85cbc8-d6a7-4b73-b511-b419c581a2fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'fc9aa7d4-2600-448e-b2e4-9004cbcee079'}}] {{(pid=92565) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:06:25.862633 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:25.932574 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:26.075901 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:26.077753 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1547fab-727a-47ce-b5c5-9294dc4e52f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=75a25fc7-99b1-4a28-bfdf-8fe172f15152,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:26.088038 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b1547fab-727a-47ce-b5c5-9294dc4e52f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.344s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:26.092603 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b1547fab-727a-47ce-b5c5-9294dc4e52f2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:26.093767 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-b1547fab-727a-47ce-b5c5-9294dc4e52f2 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/75a25fc7-99b1-4a28-bfdf-8fe172f15152 HTTP/1.1" status: 204  len: 168 time: 1.3844051
Jun 01 10:06:26.124095 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6cfac790-a934-40c5-83a7-c7ee16df58e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:26.138214 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6cfac790-a934-40c5-83a7-c7ee16df58e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Usage tracker for resource:security_group_rule and tenant:f4f6f875519045a39c1fdbadd53ce517 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:26.147211 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-fca44f6d-cbcb-4ccd-aa2e-c44ba0f9674e tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:26.155128 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-fca44f6d-cbcb-4ccd-aa2e-c44ba0f9674e tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/networks?id=34268ce8-8baf-41d5-acbc-1b6c167dd481 HTTP/1.1" status: 200  len: 819 time: 0.4959245
Jun 01 10:06:26.157893 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6cfac790-a934-40c5-83a7-c7ee16df58e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:26.183584 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] For port 1f8c5c86-a9a1-4720-821c-f7e5d5c18184, host hv-cinder-78726, cleared binding levels {{(pid=92565) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:06:26.184412 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-602b7c56-4493-4594-8571-e9915339df54 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/quotas/ef4bc75ba53a44cca2e4b7c2b8aeb818 HTTP/1.1" status: 200  len: 375 time: 0.0281549
Jun 01 10:06:26.196545 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:26.251407 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6cfac790-a934-40c5-83a7-c7ee16df58e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:26.402168 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:26.478739 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6cfac790-a934-40c5-83a7-c7ee16df58e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:26.563866 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-62cc7766-03cf-464d-bf46-d780dc813290 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=ef4bc75ba53a44cca2e4b7c2b8aeb818&fields=id HTTP/1.1" status: 200  len: 255 time: 0.3784900
Jun 01 10:06:26.606591 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:26.607228 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:26.632042 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:26.636388 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] For port 1f8c5c86-a9a1-4720-821c-f7e5d5c18184, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=1f8c5c86-a9a1-4720-821c-f7e5d5c18184,segment=NetworkSegment(db85cbc8-d6a7-4b73-b511-b419c581a2fb),segment_id=db85cbc8-d6a7-4b73-b511-b419c581a2fb)] {{(pid=92565) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:06:26.869152 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 5a1ced49-9531-4fcc-b7ac-004241b95c6b up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:26.882352 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:26.883838 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:26.889764 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:26.943922 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-1459d919-7c1e-4375-8c05-02cec029c529 service neutron] 10.222.0.68 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3703709
Jun 01 10:06:26.954481 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Notify callbacks [] for port, precommit_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:26.977124 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6cfac790-a934-40c5-83a7-c7ee16df58e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:26.996853 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.provisioning_blocks [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Transition to ACTIVE for port object 2313fd35-8139-4639-b9e5-bd9fc71943ca will not be triggered until provisioned by entity L2. {{(pid=92568) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:27.064735 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:27.075404 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:27.084718 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event updated for resources: {'Port': ['ID=2a5e6d0f-fcce-4d41-a102-68d2d2a33315,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:27.100592 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:27.100710 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1001e1bf-db2f-46e0-808e-d286db8c28ce admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:27.123382 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 5a1ced49-9531-4fcc-b7ac-004241b95c6b completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:27.126778 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 5a1ced49-9531-4fcc-b7ac-004241b95c6b triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:27.127367 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:27.134883 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cfac790-a934-40c5-83a7-c7ee16df58e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event updated for resources: {'SecurityGroup': ['ID=325ff63e-d052-497f-a7db-055e207d9f35,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:27.141413 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6cfac790-a934-40c5-83a7-c7ee16df58e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:27.157390 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6cfac790-a934-40c5-83a7-c7ee16df58e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:27.158627 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-6cfac790-a934-40c5-83a7-c7ee16df58e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1780 time: 1.5867505
Jun 01 10:06:27.174685 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 57312) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:27.187960 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-4a414974-9bab-4af8-ac6e-747a28d1befd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Request body: {'security_group_rule': {'security_group_id': '325ff63e-d052-497f-a7db-055e207d9f35', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:27.201223 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-4a414974-9bab-4af8-ac6e-747a28d1befd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:27.202669 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-4a414974-9bab-4af8-ac6e-747a28d1befd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Usage tracker for resource:security_group_rule and tenant:f4f6f875519045a39c1fdbadd53ce517 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:27.206204 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-4a414974-9bab-4af8-ac6e-747a28d1befd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:27.214454 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-4a414974-9bab-4af8-ac6e-747a28d1befd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:27.257673 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98336242-accf-4ffa-8ebc-99961d762da3 req-b8ddf6a7-e1d2-4e36-b58d-46710f411038 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:27.261971 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Pushing event updated for resources: {'Port': ['ID=1f8c5c86-a9a1-4720-821c-f7e5d5c18184,revision_number=3']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:27.269561 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-98336242-accf-4ffa-8ebc-99961d762da3 req-b8ddf6a7-e1d2-4e36-b58d-46710f411038 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 943 time: 0.5216525
Jun 01 10:06:27.298875 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.409s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:27.303410 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:27.305591 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 6.9732893
Jun 01 10:06:27.306839 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.184s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:27.307360 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:27.321431 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:27.322451 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:27.324227 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] 10.222.0.30 "PUT /v2.0/ports/1f8c5c86-a9a1-4720-821c-f7e5d5c18184 HTTP/1.1" status: 200  len: 1093 time: 6.7454479
Jun 01 10:06:27.332069 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2abcfd9c-55d9-46ea-8a25-6a89998bf874', 'tag': '1f8c5c86-a9a1-4720-821c-f7e5d5c18184'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:06:27.519765 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4a414974-9bab-4af8-ac6e-747a28d1befd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:27.564477 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68c1fac1-3db5-4562-bdd9-96a0277000f1 None None] Pushing event updated for resources: {'Port': ['ID=2313fd35-8139-4639-b9e5-bd9fc71943ca,revision_number=3']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:27.577305 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-68c1fac1-3db5-4562-bdd9-96a0277000f1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.505s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:27.649857 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-b5c0b330-733c-4109-99d6-40022a2f32f1 service neutron] 10.222.0.68 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6920083
Jun 01 10:06:27.747623 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-98336242-accf-4ffa-8ebc-99961d762da3 req-9117efae-8148-4b8a-a70b-04229ff258b9 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4751809
Jun 01 10:06:27.797148 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:27.821323 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 5a1ced49-9531-4fcc-b7ac-004241b95c6b, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=5a1ced49-9531-4fcc-b7ac-004241b95c6b,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:27.933955 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:27.938110 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:27.962023 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Attempting to bind port 2313fd35-8139-4639-b9e5-bd9fc71943ca on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:06:27.962023 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Attempting to bind port 2313fd35-8139-4639-b9e5-bd9fc71943ca by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '3982460c-82d6-48e1-a5bd-5d7cbbe910af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481'}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:06:27.962023 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Attempting to bind port 2313fd35-8139-4639-b9e5-bd9fc71943ca on network 34268ce8-8baf-41d5-acbc-1b6c167dd481 {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:27.967872 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82580940-9021-41ce-a04d-18275a28fca8 req-ee6a9ffd-1087-43af-a434-07db90d5040c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:27.992287 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 6, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:06:27.992669 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Checking segment: {'id': '3982460c-82d6-48e1-a5bd-5d7cbbe910af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92568) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:06:27.993076 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:27.993655 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-ee6a9ffd-1087-43af-a434-07db90d5040c service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=17dcefd313724cf2abaacb81a9e0729c&device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 1096 time: 0.3692770
Jun 01 10:06:27.995504 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Bound using segment: {'id': '3982460c-82d6-48e1-a5bd-5d7cbbe910af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481'} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:06:27.996004 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Bound port: 2313fd35-8139-4639-b9e5-bd9fc71943ca, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3982460c-82d6-48e1-a5bd-5d7cbbe910af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481'}}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:06:27.996390 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:27.999935 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4a414974-9bab-4af8-ac6e-747a28d1befd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:28.066301 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4a414974-9bab-4af8-ac6e-747a28d1befd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:28.073898 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:28.190933 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-faad05ea-d7bb-4ec2-bc5d-2c437982f2a4 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=1f8c5c86-a9a1-4720-821c-f7e5d5c18184 HTTP/1.1" status: 200  len: 217 time: 0.1960115
Jun 01 10:06:28.270072 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=5a1ced49-9531-4fcc-b7ac-004241b95c6b,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:28.283730 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.345s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:28.330548 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82580940-9021-41ce-a04d-18275a28fca8 req-7305315e-8596-42af-b6c2-2ed3ee83590e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:28.332825 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] For port 2313fd35-8139-4639-b9e5-bd9fc71943ca, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92568) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:06:28.333154 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a414974-9bab-4af8-ac6e-747a28d1befd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=253cbe33-8460-487b-b049-8b6c6e3b6a0c,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:28.338492 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4a414974-9bab-4af8-ac6e-747a28d1befd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:28.342596 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-4a414974-9bab-4af8-ac6e-747a28d1befd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 1.1647048
Jun 01 10:06:28.343288 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-7305315e-8596-42af-b6c2-2ed3ee83590e service neutron] 10.222.0.30 "GET /v2.0/subnets?id=acb0c106-1f4c-4cf1-9985-fb4e642b58bb HTTP/1.1" status: 200  len: 851 time: 0.1437802
Jun 01 10:06:28.344526 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 57374) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:28.347260 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-4a414974-9bab-4af8-ac6e-747a28d1befd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.272s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:28.371010 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] For port 2313fd35-8139-4639-b9e5-bd9fc71943ca, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=2313fd35-8139-4639-b9e5-bd9fc71943ca,segment=NetworkSegment(3982460c-82d6-48e1-a5bd-5d7cbbe910af),segment_id=3982460c-82d6-48e1-a5bd-5d7cbbe910af)] {{(pid=92568) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:06:28.440627 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:28.455949 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-e60d8ffc-c4d5-4007-80a5-28a7e9c2ae04 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Request body: {'security_group_rule': {'security_group_id': '325ff63e-d052-497f-a7db-055e207d9f35', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:28.466536 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-9b87f0e2-da6e-46ad-8416-2798c78084b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:28.474681 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-e60d8ffc-c4d5-4007-80a5-28a7e9c2ae04 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:28.497351 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-e60d8ffc-c4d5-4007-80a5-28a7e9c2ae04 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Usage tracker for resource:security_group_rule and tenant:f4f6f875519045a39c1fdbadd53ce517 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:28.500721 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-e60d8ffc-c4d5-4007-80a5-28a7e9c2ae04 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:28.512685 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-e60d8ffc-c4d5-4007-80a5-28a7e9c2ae04 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:28.529444 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-2c2e9d03-34ce-4f82-bb78-a0608cff406c service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=fc9aa7d4-2600-448e-b2e4-9004cbcee079&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1773481
Jun 01 10:06:28.549486 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a84ccb37-5a8a-4d22-b38e-ea1d212c7594 req-426fd750-4d32-4354-af77-37ebd5ba6b52 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 210 time: 0.3191254
Jun 01 10:06:28.583968 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-ce00c9ac-8a15-4ecd-bbac-6edbd2b880a9 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Synchronizing usage tracker for tenant:d13dc1de700d428a8982ca87f11948d0 on resource:security_group {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:06:28.630262 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Routers {'369d44f0-4eb2-4ec0-94e5-1562c07efd26'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:06:28.630925 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7273fbb0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:06:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['369d44f0-4eb2-4ec0-94e5-1562c07efd26'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:28.634940 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Sync routers for ids ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:06:28.662243 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Routers {'d65374d4-451b-4890-a2f5-a4bcac5a9a38'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:06:28.662243 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72840910>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:06:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:28.739269 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-ce00c9ac-8a15-4ecd-bbac-6edbd2b880a9 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Unset dirty status for tenant:d13dc1de700d428a8982ca87f11948d0 on resource:security_group {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:06:28.749661 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-ce00c9ac-8a15-4ecd-bbac-6edbd2b880a9 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?name=tempest-securitygroup--1278143630&fields=id&tenant_id=d13dc1de700d428a8982ca87f11948d0 HTTP/1.1" status: 200  len: 267 time: 0.5053639
Jun 01 10:06:28.853218 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] Set router 369d44f0-4eb2-4ec0-94e5-1562c07efd26 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:06:28.857572 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a5b2f58b-9f52-4c60-b678-2eb8cb103c19" -d '{"events": [{"name": "network-changed", "server_uuid": "2abcfd9c-55d9-46ea-8a25-6a89998bf874", "tag": "1f8c5c86-a9a1-4720-821c-f7e5d5c18184"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:06:28.906805 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-e60d8ffc-c4d5-4007-80a5-28a7e9c2ae04 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:29.190727 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-e60d8ffc-c4d5-4007-80a5-28a7e9c2ae04 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:29.228544 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68c1fac1-3db5-4562-bdd9-96a0277000f1 None None] Pushing event updated for resources: {'Port': ['ID=2313fd35-8139-4639-b9e5-bd9fc71943ca,revision_number=4']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:29.263064 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-68c1fac1-3db5-4562-bdd9-96a0277000f1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.805s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:29.302770 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-d8c5a3da-c948-44a7-beeb-c9befef4fc6d service neutron] 10.222.0.30 "GET /v2.0/networks/fc9aa7d4-2600-448e-b2e4-9004cbcee079?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.7343156
Jun 01 10:06:29.305678 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-e60d8ffc-c4d5-4007-80a5-28a7e9c2ae04 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:29.305678 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:29.389814 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Set router d65374d4-451b-4890-a2f5-a4bcac5a9a38 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:06:29.416970 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.30', 60226) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:29.467447 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e60d8ffc-c4d5-4007-80a5-28a7e9c2ae04 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9074dd25-a5d4-4f30-8bdf-50412a2faa29,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:29.480025 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-e60d8ffc-c4d5-4007-80a5-28a7e9c2ae04 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:29.481465 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-e60d8ffc-c4d5-4007-80a5-28a7e9c2ae04 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 1.1349149
Jun 01 10:06:29.484926 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 57418) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:29.486048 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-e60d8ffc-c4d5-4007-80a5-28a7e9c2ae04 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:29.596903 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-13c367c4-4b12-4b3c-ad2b-6954c12a8a07 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:29.609123 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-13c367c4-4b12-4b3c-ad2b-6954c12a8a07 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/networks?id=3d9ff4d3-b145-4108-a593-976a9cfb63dc HTTP/1.1" status: 200  len: 810 time: 0.8530986
Jun 01 10:06:29.677573 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7273fbb0>, [{'id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'name': 'tempest-ServerRescueNegativeTestJSON-1852296292-router', 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.219'}], 'enable_snat': True}, 'gw_port_id': 'd943f1f4-e253-47b0-93f0-2e7e1f117536', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:14Z', 'revision_number': 4, 'project_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'gw_port': {'id': 'd943f1f4-e253-47b0-93f0-2e7e1f117536', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:8b:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '2313fd35-8139-4639-b9e5-bd9fc71943ca', 'name': '', 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481', 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'mac_address': 'fa:16:3e:3d:00:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'device_owner': 'network:router_interface', 'standard_attr_id': 87, 'fixed_ips': [{'subnet_id': '2ee54c26-f286-4f9a-b791-24aa84feb26a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:12Z', 'updated_at': '2021-06-01T10:06:28Z', 'revision_number': 4, 'project_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'subnets': [{'id': '2ee54c26-f286-4f9a-b791-24aa84feb26a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:29.689426 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a1e7fd8-a97a-4a35-b006-7a79c4d8c68b None None] The sync data for ids ['369d44f0-4eb2-4ec0-94e5-1562c07efd26'] in dv-cinder-787262-4-iscsi is: [{'id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'name': 'tempest-ServerRescueNegativeTestJSON-1852296292-router', 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.219'}], 'enable_snat': True}, 'gw_port_id': 'd943f1f4-e253-47b0-93f0-2e7e1f117536', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:14Z', 'revision_number': 4, 'project_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'gw_port': {'id': 'd943f1f4-e253-47b0-93f0-2e7e1f117536', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:8b:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '2313fd35-8139-4639-b9e5-bd9fc71943ca', 'name': '', 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481', 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'mac_address': 'fa:16:3e:3d:00:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'device_owner': 'network:router_interface', 'standard_attr_id': 87, 'fixed_ips': [{'subnet_id': '2ee54c26-f286-4f9a-b791-24aa84feb26a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:12Z', 'updated_at': '2021-06-01T10:06:28Z', 'revision_number': 4, 'project_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'subnets': [{'id': '2ee54c26-f286-4f9a-b791-24aa84feb26a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:06:29.765833 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Request body: {'floatingip': {'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:29.808897 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:29.828254 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57b98f1-a959-4f38-8d43-cc6c6adf4351 req-0a578c98-afd5-402c-b60a-91075cbe69c6 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:29.836892 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d57b98f1-a959-4f38-8d43-cc6c6adf4351 req-0a578c98-afd5-402c-b60a-91075cbe69c6 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 943 time: 0.6743896
Jun 01 10:06:29.869111 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Usage tracker for resource:floatingip and tenant:f4f6f875519045a39c1fdbadd53ce517 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:29.874214 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-82580940-9021-41ce-a04d-18275a28fca8 req-7c8fe68e-a0b5-4612-b798-3ccaaa85da06 service neutron] 10.222.0.30 "GET /v2.0/networks/fc9aa7d4-2600-448e-b2e4-9004cbcee079?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4844117
Jun 01 10:06:29.875299 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:29.877177 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-dcbc01b5-60c8-4bb0-a7ff-848f8768ed5b tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/quotas/d13dc1de700d428a8982ca87f11948d0 HTTP/1.1" status: 200  len: 375 time: 0.2670379
Jun 01 10:06:29.884414 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:29.992621 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for floatingip, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:30.224789 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 2313fd35-8139-4639-b9e5-bd9fc71943ca up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:30.259006 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d57b98f1-a959-4f38-8d43-cc6c6adf4351 req-aacea574-11c6-415c-908c-ff83e6b389cf tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3985605
Jun 01 10:06:30.359091 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-92beddb0-7516-437d-8c68-f96c4eaffcf2 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Synchronizing usage tracker for tenant:d13dc1de700d428a8982ca87f11948d0 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:06:30.406448 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-be551ffa-30e4-442b-b45a-4bd17332cd25 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:30.410535 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-be551ffa-30e4-442b-b45a-4bd17332cd25 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.30 "GET /v2.0/networks?id=34268ce8-8baf-41d5-acbc-1b6c167dd481 HTTP/1.1" status: 200  len: 819 time: 0.9892380
Jun 01 10:06:30.464001 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Request body: {'port': {'device_id': '28696956-78ff-4e48-8a25-b702828c16d5', 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481', 'admin_state_up': True, 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:30.467313 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:30.476250 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72840910>, [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:18Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '476d2473-d40f-4cca-8a85-8b1ea30a5281', 'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'mac_address': 'fa:16:3e:87:a6:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:15Z', 'updated_at': '2021-06-01T10:06:19Z', 'revision_number': 2, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'subnets': [{'id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:30.481942 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Checking router: d65374d4-451b-4890-a2f5-a4bcac5a9a38 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:06:30.482306 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Updating router d65374d4-451b-4890-a2f5-a4bcac5a9a38 port 476d2473-d40f-4cca-8a85-8b1ea30a5281 binding host dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:06:30.501003 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-92beddb0-7516-437d-8c68-f96c4eaffcf2 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Unset dirty status for tenant:d13dc1de700d428a8982ca87f11948d0 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:06:30.506318 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-92beddb0-7516-437d-8c68-f96c4eaffcf2 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=d13dc1de700d428a8982ca87f11948d0&fields=id HTTP/1.1" status: 200  len: 348 time: 0.6283112
Jun 01 10:06:30.544424 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 2313fd35-8139-4639-b9e5-bd9fc71943ca completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:30.568413 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 2313fd35-8139-4639-b9e5-bd9fc71943ca triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:30.573698 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:30.675758 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:30.920712 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:30.937465 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Usage tracker for resource:port and tenant:ef4bc75ba53a44cca2e4b7c2b8aeb818 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:30.938589 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Allocated IP 172.27.2.156 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/007db53e-7ad3-414b-9328-2fcfc4b2ba7b) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:06:30.948696 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Quota usage for port was recalculated. Used quota:1. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:30.972207 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:31.071385 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Made reservation on behalf of ef4bc75ba53a44cca2e4b7c2b8aeb818 for: {'port': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:06:31.076206 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:31.196882 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:31.208943 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:06:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3a1a993a-6e04-44e7-ba6a-cf719c95a6ed x-openstack-request-id: req-3a1a993a-6e04-44e7-ba6a-cf719c95a6ed {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:06:31.209258 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2abcfd9c-55d9-46ea-8a25-6a89998bf874", "tag": "1f8c5c86-a9a1-4720-821c-f7e5d5c18184", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:06:31.209743 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-3a1a993a-6e04-44e7-ba6a-cf719c95a6ed {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:06:31.210316 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2abcfd9c-55d9-46ea-8a25-6a89998bf874', 'tag': '1f8c5c86-a9a1-4720-821c-f7e5d5c18184', 'status': 'completed', 'code': 200}
Jun 01 10:06:31.304571 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:31.336247 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Allocated IP 172.20.0.7 (34268ce8-8baf-41d5-acbc-1b6c167dd481/2ee54c26-f286-4f9a-b791-24aa84feb26a/18b5c352-ee0c-425b-a1bf-666d362844b9) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:06:31.611651 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-015a6877-38d4-46aa-970c-79a12f57cd72 req-024a754c-2a3f-4576-af39-c5743da56086 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 210 time: 0.1915541
Jun 01 10:06:31.817678 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:31.835408 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 2313fd35-8139-4639-b9e5-bd9fc71943ca, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=2313fd35-8139-4639-b9e5-bd9fc71943ca,segment=NetworkSegment(3982460c-82d6-48e1-a5bd-5d7cbbe910af),segment_id=3982460c-82d6-48e1-a5bd-5d7cbbe910af)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:31.873576 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.30', 60232) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:31.874414 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-5cac58a8-5685-4c6b-a9b0-69d16cb71c71 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:32.029131 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:32.030150 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 5a1ced49-9531-4fcc-b7ac-004241b95c6b up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:32.125163 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-40fcd4ff-1a61-44af-b829-97d57e024f13 service neutron] http://10.222.0.68:9696/v2.0/extensions returned with HTTP 200 {{(pid=92566) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 10:06:32.127355 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-40fcd4ff-1a61-44af-b829-97d57e024f13 service neutron] 10.222.0.68 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.5833380
Jun 01 10:06:32.168210 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:32.218848 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:32.336079 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:32.370083 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:06:32.382728 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:32.407926 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event updated for resources: {'Port': ['ID=007db53e-7ad3-414b-9328-2fcfc4b2ba7b,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:32.418048 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b2f58b-9f52-4c60-b678-2eb8cb103c19 req-6c96d71a-917f-4ca6-b94b-45db63a3b433 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:32.419805 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a5b2f58b-9f52-4c60-b678-2eb8cb103c19 req-6c96d71a-917f-4ca6-b94b-45db63a3b433 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=17dcefd313724cf2abaacb81a9e0729c&device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 1096 time: 1.0597804
Jun 01 10:06:32.423041 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.549s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:32.523997 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d9263c0-2659-4740-b80b-c1910143adce req-759ce2d7-aea4-43f3-b390-c422946dd681 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:32.545803 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4d9263c0-2659-4740-b80b-c1910143adce req-759ce2d7-aea4-43f3-b390-c422946dd681 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 943 time: 0.5888307
Jun 01 10:06:32.559023 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-6ae31f1f-d497-4779-b29c-129ad190faef service neutron] 10.222.0.68 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4161651
Jun 01 10:06:32.620351 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Notify callbacks [] for port, precommit_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:32.678433 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Transition to ACTIVE for port object 476d2473-d40f-4cca-8a85-8b1ea30a5281 will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:32.689736 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=2313fd35-8139-4639-b9e5-bd9fc71943ca,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:32.694213 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.475s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:32.712424 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 5a1ced49-9531-4fcc-b7ac-004241b95c6b triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:32.712424 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:32.779961 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-cb3a5e85-c216-46ee-899c-c3d9e9a55b2c tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:32.781736 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-cb3a5e85-c216-46ee-899c-c3d9e9a55b2c tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.30 "GET /v2.0/networks?id=34268ce8-8baf-41d5-acbc-1b6c167dd481 HTTP/1.1" status: 200  len: 819 time: 0.8292329
Jun 01 10:06:32.809680 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:32.829139 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Request body: {'port': {'device_id': 'c12e6393-ac9a-4707-a81b-f2c2c369c53a', 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481', 'admin_state_up': True, 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:32.833764 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:32.856915 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:32.859425 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b2f58b-9f52-4c60-b678-2eb8cb103c19 req-0a3020c7-d962-41b5-b704-b9880b6f3542 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:32.861078 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a5b2f58b-9f52-4c60-b678-2eb8cb103c19 req-0a3020c7-d962-41b5-b704-b9880b6f3542 service neutron] 10.222.0.30 "GET /v2.0/networks?id=fc9aa7d4-2600-448e-b2e4-9004cbcee079 HTTP/1.1" status: 200  len: 912 time: 0.4342792
Jun 01 10:06:32.881359 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:32.938834 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-59f49c3d-64ba-44f6-9caa-382f49c41454 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:33.019173 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4d9263c0-2659-4740-b80b-c1910143adce req-3f367ecd-6611-4680-9bbf-2d9ddd938f75 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4550419
Jun 01 10:06:33.099283 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99e87755-dd8f-4ad9-97bb-51f119d41410 None None] Pushing event updated for resources: {'Port': ['ID=476d2473-d40f-4cca-8a85-8b1ea30a5281,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:33.105964 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-99e87755-dd8f-4ad9-97bb-51f119d41410 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.249s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:33.206611 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Network 34268ce8-8baf-41d5-acbc-1b6c167dd481 is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:33.219672 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:33.235376 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:06:33.243198 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:33.244721 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:33.350463 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-76f4af10-1721-494d-8b41-72dd87085b34 req-46f40055-57d1-448b-a1a8-bbf429c286ee tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 210 time: 0.0832386
Jun 01 10:06:33.408899 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Pushing event updated for resources: {'Port': ['ID=18b5c352-ee0c-425b-a1bf-666d362844b9,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:33.421900 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.482s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:33.439059 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a5b2f58b-9f52-4c60-b678-2eb8cb103c19 req-776e458a-ce3c-4ba8-aaa2-0fc0f465ac56 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=1f8c5c86-a9a1-4720-821c-f7e5d5c18184 HTTP/1.1" status: 200  len: 217 time: 0.3998628
Jun 01 10:06:33.443305 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-93006594-d7c9-4e32-a8c8-82b220779b9c service neutron] 10.222.0.68 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.8825529
Jun 01 10:06:33.467643 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 3.0205653
Jun 01 10:06:33.476270 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 2313fd35-8139-4639-b9e5-bd9fc71943ca up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:33.512931 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:33.539053 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Request body: {'port': {'device_id': '28696956-78ff-4e48-8a25-b702828c16d5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:33.584901 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Attempting to bind port 476d2473-d40f-4cca-8a85-8b1ea30a5281 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:06:33.585595 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Attempting to bind port 476d2473-d40f-4cca-8a85-8b1ea30a5281 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '718fdfa6-b13d-46f9-85ca-8438bc5d308c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:06:33.586016 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Attempting to bind port 476d2473-d40f-4cca-8a85-8b1ea30a5281 on network be546533-cf92-483d-9e38-7d14ca9c4902 {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:33.598232 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 6, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:06:33.599428 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Checking segment: {'id': '718fdfa6-b13d-46f9-85ca-8438bc5d308c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:06:33.599832 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:33.601543 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Bound using segment: {'id': '718fdfa6-b13d-46f9-85ca-8438bc5d308c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:06:33.601543 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Bound port: 476d2473-d40f-4cca-8a85-8b1ea30a5281, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '718fdfa6-b13d-46f9-85ca-8438bc5d308c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:06:33.601543 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:33.673992 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:33.677820 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b2f58b-9f52-4c60-b678-2eb8cb103c19 req-444dac8c-8022-4dff-ae91-2d913440a54d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:33.679414 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a5b2f58b-9f52-4c60-b678-2eb8cb103c19 req-444dac8c-8022-4dff-ae91-2d913440a54d service neutron] 10.222.0.30 "GET /v2.0/subnets?id=acb0c106-1f4c-4cf1-9985-fb4e642b58bb HTTP/1.1" status: 200  len: 851 time: 0.1365292
Jun 01 10:06:33.684073 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Usage tracker for resource:port and tenant:ef4bc75ba53a44cca2e4b7c2b8aeb818 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:33.688583 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Quota usage for port was recalculated. Used quota:2. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:33.755808 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:33.762454 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a5b2f58b-9f52-4c60-b678-2eb8cb103c19 req-b5cef0b9-b066-44be-94b7-f8e6c6378bd8 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=fc9aa7d4-2600-448e-b2e4-9004cbcee079&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0565848
Jun 01 10:06:33.772190 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 2313fd35-8139-4639-b9e5-bd9fc71943ca triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:33.772564 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:33.795273 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:33.873377 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] For port 476d2473-d40f-4cca-8a85-8b1ea30a5281, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:06:33.929442 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] For port 476d2473-d40f-4cca-8a85-8b1ea30a5281, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=476d2473-d40f-4cca-8a85-8b1ea30a5281,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:06:33.957751 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Made reservation on behalf of ef4bc75ba53a44cca2e4b7c2b8aeb818 for: {'port': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:06:33.962235 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:34.028319 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:34.036999 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:34.063633 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 57556) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:34.074974 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ca78ce7a-8c5b-448c-a64e-b0b791e1e60b req-42f9d6a1-443b-4c51-a3ed-6bc93a094627 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 210 time: 0.2031281
Jun 01 10:06:34.172192 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Routers {'d65374d4-451b-4890-a2f5-a4bcac5a9a38'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:06:34.172977 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72840910>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:06:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:34.205864 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 57570) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:34.236543 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:34.238982 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a5b2f58b-9f52-4c60-b678-2eb8cb103c19 req-738572dc-8b9b-4d4d-98c4-94b114a96db7 service neutron] 10.222.0.30 "GET /v2.0/networks/fc9aa7d4-2600-448e-b2e4-9004cbcee079?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4136908
Jun 01 10:06:34.261119 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99e87755-dd8f-4ad9-97bb-51f119d41410 None None] Pushing event updated for resources: {'Port': ['ID=476d2473-d40f-4cca-8a85-8b1ea30a5281,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:34.283840 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-99e87755-dd8f-4ad9-97bb-51f119d41410 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:34.392763 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:34.413397 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f8563e89-71e8-431e-8369-a9d80f589d89 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:34.524720 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:34.559380 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] Set router d65374d4-451b-4890-a2f5-a4bcac5a9a38 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:06:34.581744 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a5b2f58b-9f52-4c60-b678-2eb8cb103c19 req-e9e57654-01a8-41b6-8f98-96dea8cb02e7 service neutron] 10.222.0.30 "GET /v2.0/networks/fc9aa7d4-2600-448e-b2e4-9004cbcee079?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3295391
Jun 01 10:06:34.585123 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event updated for resources: {'Port': ['ID=007db53e-7ad3-414b-9328-2fcfc4b2ba7b,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:34.600769 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:34.675724 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:34.679636 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 5.1903017
Jun 01 10:06:34.760914 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-356bd306-ca9b-448a-9453-ea7392e50088 req-4ac8ff7b-1a24-4baa-a5da-3bc8ad87ded7 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Synchronizing usage tracker for tenant:ef4bc75ba53a44cca2e4b7c2b8aeb818 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:06:34.781263 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5570c3a0-47a2-489b-bd65-e73dfc902513 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:34.801036 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-e601dde6-621a-420a-b252-438c4f8e45ed admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:34.843385 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-5570c3a0-47a2-489b-bd65-e73dfc902513 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:34.848890 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-e601dde6-621a-420a-b252-438c4f8e45ed admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:34.873906 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c31dd63d-41e5-41eb-81ca-1cd4ae4fa91b req-252ca894-cf31-4db3-a8bb-8ff2eb14e41a tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:34.875581 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c31dd63d-41e5-41eb-81ca-1cd4ae4fa91b req-252ca894-cf31-4db3-a8bb-8ff2eb14e41a tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 943 time: 0.6169236
Jun 01 10:06:34.876607 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-e601dde6-621a-420a-b252-438c4f8e45ed admin admin] Usage tracker for resource:security_group_rule and tenant:601bf79122794e7aa3517eb5e64653af is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:34.879663 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-5570c3a0-47a2-489b-bd65-e73dfc902513 admin admin] Usage tracker for resource:security_group_rule and tenant:ad7f475875704f79829c0f5cfae5703c is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:34.885306 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-e601dde6-621a-420a-b252-438c4f8e45ed admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:34.888095 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-5570c3a0-47a2-489b-bd65-e73dfc902513 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:34.903862 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-5570c3a0-47a2-489b-bd65-e73dfc902513 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:34.918033 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-e601dde6-621a-420a-b252-438c4f8e45ed admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:34.929748 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-356bd306-ca9b-448a-9453-ea7392e50088 req-4ac8ff7b-1a24-4baa-a5da-3bc8ad87ded7 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Unset dirty status for tenant:ef4bc75ba53a44cca2e4b7c2b8aeb818 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:06:34.931086 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-356bd306-ca9b-448a-9453-ea7392e50088 req-4ac8ff7b-1a24-4baa-a5da-3bc8ad87ded7 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 210 time: 0.3533294
Jun 01 10:06:34.997386 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72840910>, [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:18Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '476d2473-d40f-4cca-8a85-8b1ea30a5281', 'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'mac_address': 'fa:16:3e:87:a6:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:15Z', 'updated_at': '2021-06-01T10:06:33Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'subnets': [{'id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:06:35.003885 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c31dd63d-41e5-41eb-81ca-1cd4ae4fa91b req-072dd688-5266-472e-bd32-58617fe4eb1f tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1129313
Jun 01 10:06:35.010783 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bcff989-336f-4241-9cf8-0df16d8e74fc None None] The sync data for ids ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'] in dv-cinder-787262-4-iscsi is: [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:18Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '476d2473-d40f-4cca-8a85-8b1ea30a5281', 'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'mac_address': 'fa:16:3e:87:a6:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:15Z', 'updated_at': '2021-06-01T10:06:33Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'subnets': [{'id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:06:35.137546 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 18b5c352-ee0c-425b-a1bf-666d362844b9 {{(pid=92566) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:06:35.161872 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:35.266224 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Transition to ACTIVE for port object 18b5c352-ee0c-425b-a1bf-666d362844b9 will not be triggered until provisioned by entity L2. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:35.273279 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-34f953ae-828b-43db-912d-0edf89356e65 req-11e2ae99-395e-4633-b2c7-9618515c9825 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Synchronizing usage tracker for tenant:f4f6f875519045a39c1fdbadd53ce517 on resource:security_group {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:06:35.277463 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6b340b7c-b964-4e29-99ee-5d74f1766e4d req-c712666d-66ac-41e8-bef7-3922c3603b40 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 210 time: 0.1097529
Jun 01 10:06:35.308925 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:06:35.350016 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-e601dde6-621a-420a-b252-438c4f8e45ed admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:35.351838 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5570c3a0-47a2-489b-bd65-e73dfc902513 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:35.387499 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:35.400028 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:35.470099 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 1f8c5c86-a9a1-4720-821c-f7e5d5c18184, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=1f8c5c86-a9a1-4720-821c-f7e5d5c18184,segment=NetworkSegment(db85cbc8-d6a7-4b73-b511-b419c581a2fb),segment_id=db85cbc8-d6a7-4b73-b511-b419c581a2fb)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:35.482575 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-e601dde6-621a-420a-b252-438c4f8e45ed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:35.486825 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-34f953ae-828b-43db-912d-0edf89356e65 req-11e2ae99-395e-4633-b2c7-9618515c9825 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Unset dirty status for tenant:f4f6f875519045a39c1fdbadd53ce517 on resource:security_group {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:06:35.488036 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34f953ae-828b-43db-912d-0edf89356e65 req-11e2ae99-395e-4633-b2c7-9618515c9825 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?name=tempest-securitygroup--2133036691&fields=id&tenant_id=f4f6f875519045a39c1fdbadd53ce517 HTTP/1.1" status: 200  len: 267 time: 0.3949172
Jun 01 10:06:35.488924 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5570c3a0-47a2-489b-bd65-e73dfc902513 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:35.495662 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': '1f8c5c86-a9a1-4720-821c-f7e5d5c18184', 'network_id': 'fc9aa7d4-2600-448e-b2e4-9004cbcee079', 'port_id': '1f8c5c86-a9a1-4720-821c-f7e5d5c18184', 'mac_address': 'fa:16:3e:d1:7b:12', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 882, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'acb0c106-1f4c-4cf1-9985-fb4e642b58bb', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:06:35.529368 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 476d2473-d40f-4cca-8a85-8b1ea30a5281 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:35.647632 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:35.674473 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:06:35.678688 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Allocated IP 172.20.0.12 (34268ce8-8baf-41d5-acbc-1b6c167dd481/2ee54c26-f286-4f9a-b791-24aa84feb26a/ea668f76-dcbd-410c-a737-019b6396ac7f) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:06:35.694119 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 1f8c5c86-a9a1-4720-821c-f7e5d5c18184, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=1f8c5c86-a9a1-4720-821c-f7e5d5c18184,segment=NetworkSegment(db85cbc8-d6a7-4b73-b511-b419c581a2fb),segment_id=db85cbc8-d6a7-4b73-b511-b419c581a2fb)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:35.727540 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 476d2473-d40f-4cca-8a85-8b1ea30a5281 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:35.733883 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 476d2473-d40f-4cca-8a85-8b1ea30a5281 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:35.734282 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:35.754607 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Pushing event updated for resources: {'Port': ['ID=18b5c352-ee0c-425b-a1bf-666d362844b9,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:35.765320 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-e601dde6-621a-420a-b252-438c4f8e45ed admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=601bf79122794e7aa3517eb5e64653af&name=default HTTP/1.1" status: 200  len: 2979 time: 1.7033806
Jun 01 10:06:35.766564 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 57618) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:35.773428 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:35.781488 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-f262f3d5-10fd-4024-9904-c7dd4b863578 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:35.824209 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.424s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:35.824960 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-621f6dbe-f8a8-4f18-851b-aed762ec9f13 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.239s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:35.955001 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=1f8c5c86-a9a1-4720-821c-f7e5d5c18184,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:35.971290 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:35.980241 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34f953ae-828b-43db-912d-0edf89356e65 req-ff9c0cf5-b724-4aaf-bd0f-a2f61f914d2f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:35.980963 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-34f953ae-828b-43db-912d-0edf89356e65 req-ff9c0cf5-b724-4aaf-bd0f-a2f61f914d2f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Synchronizing usage tracker for tenant:f4f6f875519045a39c1fdbadd53ce517 on resource:network {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:06:36.009953 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3d7b0a7f-9751-491c-a8ae-b1739b6cb50d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:36.026795 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e601dde6-621a-420a-b252-438c4f8e45ed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6bbd96ea-65bc-434b-8ffc-f2e78e219ab4,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:36.039032 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-5570c3a0-47a2-489b-bd65-e73dfc902513 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=ad7f475875704f79829c0f5cfae5703c&name=default HTTP/1.1" status: 200  len: 2979 time: 1.8329096
Jun 01 10:06:36.050171 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 57630) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:36.076849 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Attempting to bind port 18b5c352-ee0c-425b-a1bf-666d362844b9 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:06:36.077312 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Attempting to bind port 18b5c352-ee0c-425b-a1bf-666d362844b9 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '3982460c-82d6-48e1-a5bd-5d7cbbe910af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481'}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:06:36.077730 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Attempting to bind port 18b5c352-ee0c-425b-a1bf-666d362844b9 on network 34268ce8-8baf-41d5-acbc-1b6c167dd481 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:36.090501 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Port 18b5c352-ee0c-425b-a1bf-666d362844b9 on network 34268ce8-8baf-41d5-acbc-1b6c167dd481 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:06:36.091938 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Attempting to bind port 18b5c352-ee0c-425b-a1bf-666d362844b9 on network 34268ce8-8baf-41d5-acbc-1b6c167dd481 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:36.101571 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3d7b0a7f-9751-491c-a8ae-b1739b6cb50d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:36.128104 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 6, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:06:36.128242 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:36.128821 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Checking segment: {'id': '3982460c-82d6-48e1-a5bd-5d7cbbe910af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:06:36.129830 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Bound using segment: {'id': '3982460c-82d6-48e1-a5bd-5d7cbbe910af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481'} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:06:36.131769 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Bound port: 18b5c352-ee0c-425b-a1bf-666d362844b9, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3982460c-82d6-48e1-a5bd-5d7cbbe910af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481'}}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:06:36.132346 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:36.151719 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:36.157747 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5570c3a0-47a2-489b-bd65-e73dfc902513 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4b82716e-5caf-4387-a732-e7573846f157,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:36.166413 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-5570c3a0-47a2-489b-bd65-e73dfc902513 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.341s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:36.167213 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.493s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:36.167778 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:36.221740 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-34f953ae-828b-43db-912d-0edf89356e65 req-ff9c0cf5-b724-4aaf-bd0f-a2f61f914d2f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Unset dirty status for tenant:f4f6f875519045a39c1fdbadd53ce517 on resource:network {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:06:36.222921 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34f953ae-828b-43db-912d-0edf89356e65 req-ff9c0cf5-b724-4aaf-bd0f-a2f61f914d2f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/networks?id=be546533-cf92-483d-9e38-7d14ca9c4902 HTTP/1.1" status: 200  len: 816 time: 0.6373630
Jun 01 10:06:36.229512 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8e01a093-74dd-4bb7-89ac-4d9a187beb83 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:36.244850 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 476d2473-d40f-4cca-8a85-8b1ea30a5281, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=476d2473-d40f-4cca-8a85-8b1ea30a5281,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:36.277083 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8e01a093-74dd-4bb7-89ac-4d9a187beb83 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:36.283440 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8679b890-31ce-4999-b619-d160d85806fb req-f88993d9-1529-46af-b52a-5573742af7e7 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 210 time: 0.0693777
Jun 01 10:06:36.298565 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['1f8c5c86-a9a1-4720-821c-f7e5d5c18184'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:06:36.333323 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:36.342804 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:36.359435 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34f953ae-828b-43db-912d-0edf89356e65 req-3bbd4bd6-f3bf-436d-a70b-ae24dc80196f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/quotas/f4f6f875519045a39c1fdbadd53ce517 HTTP/1.1" status: 200  len: 375 time: 0.0750129
Jun 01 10:06:36.429483 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8e01a093-74dd-4bb7-89ac-4d9a187beb83 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:36.431164 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:36.436576 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3d7b0a7f-9751-491c-a8ae-b1739b6cb50d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:36.449244 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:36.499220 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e01a093-74dd-4bb7-89ac-4d9a187beb83 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b82716e-5caf-4387-a732-e7573846f157,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:36.500981 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=476d2473-d40f-4cca-8a85-8b1ea30a5281,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:36.508856 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:36.565627 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d7b0a7f-9751-491c-a8ae-b1739b6cb50d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6bbd96ea-65bc-434b-8ffc-f2e78e219ab4,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:36.569330 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-3d7b0a7f-9751-491c-a8ae-b1739b6cb50d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:36.583458 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8e01a093-74dd-4bb7-89ac-4d9a187beb83 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:36.583458 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-8e01a093-74dd-4bb7-89ac-4d9a187beb83 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/4b82716e-5caf-4387-a732-e7573846f157 HTTP/1.1" status: 204  len: 168 time: 0.5244260
Jun 01 10:06:36.583458 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-feb08877-63ca-4b45-bb93-8f5837f69c5c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.046s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:36.630064 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Network 34268ce8-8baf-41d5-acbc-1b6c167dd481 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:36.632607 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] For port 18b5c352-ee0c-425b-a1bf-666d362844b9, host hv-cinder-78726, cleared binding levels {{(pid=92566) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:06:36.647871 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:36.651498 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:06:36.658742 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:36.659607 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:36.664781 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3d7b0a7f-9751-491c-a8ae-b1739b6cb50d admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:36.665387 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] For port 18b5c352-ee0c-425b-a1bf-666d362844b9, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=18b5c352-ee0c-425b-a1bf-666d362844b9,segment=NetworkSegment(3982460c-82d6-48e1-a5bd-5d7cbbe910af),segment_id=3982460c-82d6-48e1-a5bd-5d7cbbe910af)] {{(pid=92566) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:06:36.666408 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-3d7b0a7f-9751-491c-a8ae-b1739b6cb50d admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/6bbd96ea-65bc-434b-8ffc-f2e78e219ab4 HTTP/1.1" status: 204  len: 168 time: 0.8989127
Jun 01 10:06:36.702995 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Pushing event updated for resources: {'Port': ['ID=ea668f76-dcbd-410c-a737-019b6396ac7f,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:36.706170 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:36.706614 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.156s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:36.707048 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:36.707604 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-34f953ae-828b-43db-912d-0edf89356e65 req-e1c6b33d-0b52-4860-9b4d-61518f1a7096 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Synchronizing usage tracker for tenant:f4f6f875519045a39c1fdbadd53ce517 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:06:36.722694 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d6b7c09-1f19-4f41-b1c6-c8db69331ded req-cb2f7695-dfb8-44b8-a027-be3c3545f178 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:36.723259 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1d6b7c09-1f19-4f41-b1c6-c8db69331ded req-cb2f7695-dfb8-44b8-a027-be3c3545f178 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 944 time: 0.1555808
Jun 01 10:06:36.779486 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 3.9651766
Jun 01 10:06:36.779684 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:36.788255 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1d6b7c09-1f19-4f41-b1c6-c8db69331ded req-c8fd0418-4440-4f41-bc4c-fc897d507435 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0557773
Jun 01 10:06:36.789797 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-5f82b6f2-aab6-42fb-b611-c8b960103170 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:36.793026 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Request body: {'port': {'device_id': 'c12e6393-ac9a-4707-a81b-f2c2c369c53a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:36.853143 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:36.853758 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:36.855213 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] 10.222.0.30 "PUT /v2.0/ports/18b5c352-ee0c-425b-a1bf-666d362844b9 HTTP/1.1" status: 200  len: 1093 time: 3.3211684
Jun 01 10:06:36.855687 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '28696956-78ff-4e48-8a25-b702828c16d5', 'tag': '18b5c352-ee0c-425b-a1bf-666d362844b9'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:06:36.922867 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-34f953ae-828b-43db-912d-0edf89356e65 req-e1c6b33d-0b52-4860-9b4d-61518f1a7096 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Unset dirty status for tenant:f4f6f875519045a39c1fdbadd53ce517 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:06:36.927637 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34f953ae-828b-43db-912d-0edf89356e65 req-e1c6b33d-0b52-4860-9b4d-61518f1a7096 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=f4f6f875519045a39c1fdbadd53ce517&fields=id HTTP/1.1" status: 200  len: 348 time: 0.5568655
Jun 01 10:06:36.949384 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:37.032044 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-76fd6bbc-9b9e-45cb-b4f0-cbefaa46652b req-88b0cd72-874c-45fa-9425-420515f775a9 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 210 time: 0.0992196
Jun 01 10:06:37.050340 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Pushing event updated for resources: {'Port': ['ID=18b5c352-ee0c-425b-a1bf-666d362844b9,revision_number=3']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:37.145689 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.356s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:37.276456 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34f953ae-828b-43db-912d-0edf89356e65 req-3d8b96c1-da51-486d-b2fc-e47dc9f56ea4 service neutron] 10.222.0.68 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3033695
Jun 01 10:06:37.281572 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:37.285540 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-332b4cd2-8517-485c-a190-ddcc37551c52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:37.287785 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-332b4cd2-8517-485c-a190-ddcc37551c52 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=ef4bc75ba53a44cca2e4b7c2b8aeb818&device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 1096 time: 0.1434050
Jun 01 10:06:37.436650 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 476d2473-d40f-4cca-8a85-8b1ea30a5281 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:37.441460 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-b6178fbd-24dc-44ae-9c72-978d276197e9 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=18b5c352-ee0c-425b-a1bf-666d362844b9 HTTP/1.1" status: 200  len: 217 time: 0.1184394
Jun 01 10:06:37.486524 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-79368429-eaa9-42a4-977b-fb7654122adf tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:37.487279 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-79368429-eaa9-42a4-977b-fb7654122adf tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Synchronizing usage tracker for tenant:d13dc1de700d428a8982ca87f11948d0 on resource:network {{(pid=92565) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:06:37.492987 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ea668f76-dcbd-410c-a737-019b6396ac7f {{(pid=92565) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:06:37.502531 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:37.550880 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.provisioning_blocks [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Transition to ACTIVE for port object ea668f76-dcbd-410c-a737-019b6396ac7f will not be triggered until provisioned by entity L2. {{(pid=92565) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:37.569905 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 57664) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:37.601289 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:37.612036 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cb3eb52b-8828-4ec4-882a-4ba83f65fcab admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:37.641404 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-cb3eb52b-8828-4ec4-882a-4ba83f65fcab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:37.641865 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-79368429-eaa9-42a4-977b-fb7654122adf tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Unset dirty status for tenant:d13dc1de700d428a8982ca87f11948d0 on resource:network {{(pid=92565) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:06:37.643213 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-79368429-eaa9-42a4-977b-fb7654122adf tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.30 "GET /v2.0/networks?id=3d9ff4d3-b145-4108-a593-976a9cfb63dc HTTP/1.1" status: 200  len: 810 time: 0.3849392
Jun 01 10:06:37.646294 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-cb3eb52b-8828-4ec4-882a-4ba83f65fcab admin admin] Usage tracker for resource:security_group_rule and tenant:057de84eac2c4e368c46815ae5d57d0e is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:37.649940 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-cb3eb52b-8828-4ec4-882a-4ba83f65fcab admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:37.656326 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-cb3eb52b-8828-4ec4-882a-4ba83f65fcab admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:37.656954 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:37.657931 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:37.711052 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:37.730171 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:37.751613 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-fa3d1dbf-af4e-43cc-8684-aad3449693c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:37.755964 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-fa3d1dbf-af4e-43cc-8684-aad3449693c4 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2ee54c26-f286-4f9a-b791-24aa84feb26a HTTP/1.1" status: 200  len: 859 time: 0.2638135
Jun 01 10:06:37.756519 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 57672) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:37.787818 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-921daed3-2209-4664-950c-db24a8d90ab9 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Synchronizing usage tracker for tenant:d13dc1de700d428a8982ca87f11948d0 on resource:security_group {{(pid=92565) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:06:37.813495 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 476d2473-d40f-4cca-8a85-8b1ea30a5281 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:37.813495 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:37.815947 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4c1e3975-1c23-4a7e-9e4c-97114178fbc0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:37.859753 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-561c3bda-2a16-4896-9f34-7e91f262db66" -d '{"events": [{"name": "network-changed", "server_uuid": "28696956-78ff-4e48-8a25-b702828c16d5", "tag": "18b5c352-ee0c-425b-a1bf-666d362844b9"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:06:37.863908 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34f953ae-828b-43db-912d-0edf89356e65 req-0643e9ed-649e-444b-b51c-7c2cff88f959 service neutron] 10.222.0.68 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5751524
Jun 01 10:06:37.891141 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26fbe7d9-be36-4787-accd-3d6e4bbcd254 req-92304f7b-3fcc-4cdd-9b52-d91d2aca4db7 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:37.896446 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-26fbe7d9-be36-4787-accd-3d6e4bbcd254 req-92304f7b-3fcc-4cdd-9b52-d91d2aca4db7 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 932 time: 0.3630807
Jun 01 10:06:37.901429 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-4c1e3975-1c23-4a7e-9e4c-97114178fbc0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:37.905391 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-4c1e3975-1c23-4a7e-9e4c-97114178fbc0 admin admin] Usage tracker for resource:security_group_rule and tenant:9906146aa6ed4cbc9fa53384739a97b1 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:37.908348 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-4c1e3975-1c23-4a7e-9e4c-97114178fbc0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:37.918854 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-4c1e3975-1c23-4a7e-9e4c-97114178fbc0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:37.932796 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-921daed3-2209-4664-950c-db24a8d90ab9 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Unset dirty status for tenant:d13dc1de700d428a8982ca87f11948d0 on resource:security_group {{(pid=92565) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:06:37.934273 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-921daed3-2209-4664-950c-db24a8d90ab9 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d13dc1de700d428a8982ca87f11948d0 HTTP/1.1" status: 200  len: 380 time: 0.2750571
Jun 01 10:06:37.945055 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Pushing event updated for resources: {'Port': ['ID=ea668f76-dcbd-410c-a737-019b6396ac7f,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:37.958805 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:37.972272 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Request body: {'port': {'device_id': '0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'admin_state_up': True, 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'security_groups': ['ef889387-b500-43ef-a425-6324661f46cb']}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:38.000411 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4c1e3975-1c23-4a7e-9e4c-97114178fbc0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:38.018042 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Attempting to bind port ea668f76-dcbd-410c-a737-019b6396ac7f on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:06:38.018480 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-edf801b5-fd24-4cb5-8333-5d4395892f6d service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=34268ce8-8baf-41d5-acbc-1b6c167dd481&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.2037585
Jun 01 10:06:38.018881 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Attempting to bind port ea668f76-dcbd-410c-a737-019b6396ac7f by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '3982460c-82d6-48e1-a5bd-5d7cbbe910af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481'}] {{(pid=92565) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:06:38.019481 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Attempting to bind port ea668f76-dcbd-410c-a737-019b6396ac7f on network 34268ce8-8baf-41d5-acbc-1b6c167dd481 {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:38.031535 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:38.080381 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Port ea668f76-dcbd-410c-a737-019b6396ac7f on network 34268ce8-8baf-41d5-acbc-1b6c167dd481 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:06:38.080962 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Attempting to bind port ea668f76-dcbd-410c-a737-019b6396ac7f on network 34268ce8-8baf-41d5-acbc-1b6c167dd481 {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:38.096413 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2abcfd9c-55d9-46ea-8a25-6a89998bf874', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f8c5c86-a9a1-4720-821c-f7e5d5c18184'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:06:38.096848 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-26fbe7d9-be36-4787-accd-3d6e4bbcd254 req-73e8a86a-2902-43a3-83ee-0346d153d4b3 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Synchronizing usage tracker for tenant:ef4bc75ba53a44cca2e4b7c2b8aeb818 on resource:security_group {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:06:38.099265 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4c1e3975-1c23-4a7e-9e4c-97114178fbc0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:38.120719 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 6, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:06:38.121092 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Checking segment: {'id': '3982460c-82d6-48e1-a5bd-5d7cbbe910af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92565) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:06:38.121457 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Bound using segment: {'id': '3982460c-82d6-48e1-a5bd-5d7cbbe910af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481'} {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:06:38.122032 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Bound port: ea668f76-dcbd-410c-a737-019b6396ac7f, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3982460c-82d6-48e1-a5bd-5d7cbbe910af', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481'}}] {{(pid=92565) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:06:38.122484 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:38.158842 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-ba48e32d-67a0-4bf7-8fbb-e9aac2dde223 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:38.195821 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 1f8c5c86-a9a1-4720-821c-f7e5d5c18184, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=1f8c5c86-a9a1-4720-821c-f7e5d5c18184,segment=NetworkSegment(db85cbc8-d6a7-4b73-b511-b419c581a2fb),segment_id=db85cbc8-d6a7-4b73-b511-b419c581a2fb)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:38.260056 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c1e3975-1c23-4a7e-9e4c-97114178fbc0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8273058f-22b8-4bd6-bbbe-44d386e2bfc0,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:38.266537 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-4c1e3975-1c23-4a7e-9e4c-97114178fbc0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:38.277848 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-4c1e3975-1c23-4a7e-9e4c-97114178fbc0 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=9906146aa6ed4cbc9fa53384739a97b1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5161088
Jun 01 10:06:38.293391 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 57692) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:38.294034 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-26fbe7d9-be36-4787-accd-3d6e4bbcd254 req-73e8a86a-2902-43a3-83ee-0346d153d4b3 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Unset dirty status for tenant:ef4bc75ba53a44cca2e4b7c2b8aeb818 on resource:security_group {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:06:38.303313 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-26fbe7d9-be36-4787-accd-3d6e4bbcd254 req-73e8a86a-2902-43a3-83ee-0346d153d4b3 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2989945
Jun 01 10:06:38.328484 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:38.329707 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:38.418088 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-177d3608-2ebf-4b66-863f-a47d3988c1e4 service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3762560
Jun 01 10:06:38.447194 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fd1364fd-d585-49da-a226-cf512803ff08" -d '{"events": [{"server_uuid": "2abcfd9c-55d9-46ea-8a25-6a89998bf874", "name": "network-vif-plugged", "status": "completed", "tag": "1f8c5c86-a9a1-4720-821c-f7e5d5c18184"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:06:38.451501 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] For port ea668f76-dcbd-410c-a737-019b6396ac7f, host hv-cinder-78726, cleared binding levels {{(pid=92565) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:06:38.453643 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-70a17861-ee00-470f-a09f-f0b10dd19532 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:38.455310 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] For port ea668f76-dcbd-410c-a737-019b6396ac7f, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ea668f76-dcbd-410c-a737-019b6396ac7f,segment=NetworkSegment(3982460c-82d6-48e1-a5bd-5d7cbbe910af),segment_id=3982460c-82d6-48e1-a5bd-5d7cbbe910af)] {{(pid=92565) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:06:38.470520 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cb3eb52b-8828-4ec4-882a-4ba83f65fcab admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:38.484179 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-70a17861-ee00-470f-a09f-f0b10dd19532 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:38.516335 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=1f8c5c86-a9a1-4720-821c-f7e5d5c18184,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:38.529697 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:38.559260 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:38.570645 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:38.597245 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:38.608658 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cb3eb52b-8828-4ec4-882a-4ba83f65fcab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:38.611302 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-0bf24af9-16c9-4d1b-8b8a-8c8f9eb791be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:38.665105 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:06:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-194fc7e0-2d4b-443d-98f8-b0450c9a7a7a x-openstack-request-id: req-194fc7e0-2d4b-443d-98f8-b0450c9a7a7a {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:06:38.665881 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "28696956-78ff-4e48-8a25-b702828c16d5", "tag": "18b5c352-ee0c-425b-a1bf-666d362844b9", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:06:38.666315 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-194fc7e0-2d4b-443d-98f8-b0450c9a7a7a {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:06:38.666789 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '28696956-78ff-4e48-8a25-b702828c16d5', 'tag': '18b5c352-ee0c-425b-a1bf-666d362844b9', 'status': 'completed', 'code': 200}
Jun 01 10:06:38.694997 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:38.697223 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:38.698622 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-96029ef7-7793-49de-bb90-16861279f72f service neutron] 10.222.0.30 "PUT /v2.0/ports/ea668f76-dcbd-410c-a737-019b6396ac7f HTTP/1.1" status: 200  len: 1094 time: 1.9111295
Jun 01 10:06:38.700060 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c12e6393-ac9a-4707-a81b-f2c2c369c53a', 'tag': 'ea668f76-dcbd-410c-a737-019b6396ac7f'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:06:38.702334 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-feb32c74-bbe2-400c-b533-cafae43aef20" -d '{"events": [{"name": "network-changed", "server_uuid": "c12e6393-ac9a-4707-a81b-f2c2c369c53a", "tag": "ea668f76-dcbd-410c-a737-019b6396ac7f"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:06:38.712807 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-cb3eb52b-8828-4ec4-882a-4ba83f65fcab admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=057de84eac2c4e368c46815ae5d57d0e&name=default HTTP/1.1" status: 200  len: 2979 time: 1.1387398
Jun 01 10:06:38.713414 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Made reservation on behalf of d13dc1de700d428a8982ca87f11948d0 for: {'port': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:06:38.716976 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:38.725090 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-70a17861-ee00-470f-a09f-f0b10dd19532 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:38.727002 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 57716) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:38.768110 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:38.774410 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Pushing event updated for resources: {'Port': ['ID=ea668f76-dcbd-410c-a737-019b6396ac7f,revision_number=3']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:38.814985 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:38.815335 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.157s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:38.839799 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 57720) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:38.912553 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70a17861-ee00-470f-a09f-f0b10dd19532 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8273058f-22b8-4bd6-bbbe-44d386e2bfc0,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:38.918627 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-340ed17b-9745-427c-b6fe-eb79b4e6cc87 req-d3821dc9-b648-439a-b4fd-946c40c5f8fa service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4886899
Jun 01 10:06:38.942818 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bf2c09ce-ba87-4c08-a1f0-68dde6528579 req-cb028607-e582-453a-9662-06d76a7bc0e2 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 210 time: 0.1946776
Jun 01 10:06:38.955600 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-70a17861-ee00-470f-a09f-f0b10dd19532 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:38.955776 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb3eb52b-8828-4ec4-882a-4ba83f65fcab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=588b9948-61c7-460e-bb6d-1b7d359e0aa3,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:38.961420 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-70a17861-ee00-470f-a09f-f0b10dd19532 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:38.962651 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-70a17861-ee00-470f-a09f-f0b10dd19532 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/8273058f-22b8-4bd6-bbbe-44d386e2bfc0 HTTP/1.1" status: 204  len: 168 time: 0.6537666
Jun 01 10:06:38.968348 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-cb3eb52b-8828-4ec4-882a-4ba83f65fcab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:39.012362 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d8f3f62c-6a15-420d-a3fc-20066fe83a13 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:39.019513 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f9bd5bb-5476-406f-9e39-6701e3a927eb req-348b7f91-bb48-4486-a988-a7257aaa6f17 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:39.021698 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4f9bd5bb-5476-406f-9e39-6701e3a927eb req-348b7f91-bb48-4486-a988-a7257aaa6f17 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 945 time: 0.3589363
Jun 01 10:06:39.073142 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d8f3f62c-6a15-420d-a3fc-20066fe83a13 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:39.103954 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Allocated IP 172.20.0.9 (3d9ff4d3-b145-4108-a593-976a9cfb63dc/2a00a573-a4bb-4d2d-a3e6-7aef03966618/c4b8d4ae-e9e9-4d40-a923-e03752a7ad32) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:06:39.143455 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-55d05130-375d-48bb-a6a5-7efdb3ae5335 req-da070eff-6031-4e82-8733-ca72ec25a51a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 210 time: 0.1106584
Jun 01 10:06:39.163942 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-2bb762ee-b3a2-4ffa-a101-662c8c76208c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:39.168000 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-2bb762ee-b3a2-4ffa-a101-662c8c76208c service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=ef4bc75ba53a44cca2e4b7c2b8aeb818&device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 1097 time: 0.3170226
Jun 01 10:06:39.182013 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a6973b74-cbfe-40d9-a9d2-c170f7cf12a7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:39.210241 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4f9bd5bb-5476-406f-9e39-6701e3a927eb req-44fca20b-0d4f-4e6f-a46a-45cdc4ca5a65 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1788037
Jun 01 10:06:39.222218 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-a6973b74-cbfe-40d9-a9d2-c170f7cf12a7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:39.230759 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-a6973b74-cbfe-40d9-a9d2-c170f7cf12a7 admin admin] Usage tracker for resource:security_group_rule and tenant:5a22978db88049c097554bcb8fd0c098 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:39.235659 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-a6973b74-cbfe-40d9-a9d2-c170f7cf12a7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:39.251519 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-561c3bda-2a16-4896-9f34-7e91f262db66 req-c01240b2-1e13-4004-9d63-28e3ada200dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:39.251519 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-561c3bda-2a16-4896-9f34-7e91f262db66 req-c01240b2-1e13-4004-9d63-28e3ada200dd service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=ef4bc75ba53a44cca2e4b7c2b8aeb818&device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 1096 time: 0.1631711
Jun 01 10:06:39.256767 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-a6973b74-cbfe-40d9-a9d2-c170f7cf12a7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:39.338659 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:06:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c993a6a1-9782-4bd7-9124-829f5923b8ec x-openstack-request-id: req-c993a6a1-9782-4bd7-9124-829f5923b8ec {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:06:39.339221 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c12e6393-ac9a-4707-a81b-f2c2c369c53a", "tag": "ea668f76-dcbd-410c-a737-019b6396ac7f", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:06:39.339489 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-c993a6a1-9782-4bd7-9124-829f5923b8ec {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:06:39.339893 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c12e6393-ac9a-4707-a81b-f2c2c369c53a', 'tag': 'ea668f76-dcbd-410c-a737-019b6396ac7f', 'status': 'completed', 'code': 200}
Jun 01 10:06:39.365114 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d8f3f62c-6a15-420d-a3fc-20066fe83a13 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:39.377643 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:06:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3533cb09-8674-40c8-90c8-3816cc3add7d x-openstack-request-id: req-3533cb09-8674-40c8-90c8-3816cc3add7d {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:06:39.378123 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2abcfd9c-55d9-46ea-8a25-6a89998bf874", "name": "network-vif-plugged", "status": "completed", "tag": "1f8c5c86-a9a1-4720-821c-f7e5d5c18184", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:06:39.378197 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-3533cb09-8674-40c8-90c8-3816cc3add7d {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:06:39.388420 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2abcfd9c-55d9-46ea-8a25-6a89998bf874', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f8c5c86-a9a1-4720-821c-f7e5d5c18184', 'code': 200}
Jun 01 10:06:39.434153 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:39.480294 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8f3f62c-6a15-420d-a3fc-20066fe83a13 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=588b9948-61c7-460e-bb6d-1b7d359e0aa3,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:39.482615 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-d8f3f62c-6a15-420d-a3fc-20066fe83a13 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:39.513578 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde6e57d-044c-4cb5-8b8e-257b6130ad97 req-5650b7e4-8b21-4851-9f83-68aca9bfa53d tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:39.515081 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dde6e57d-044c-4cb5-8b8e-257b6130ad97 req-5650b7e4-8b21-4851-9f83-68aca9bfa53d tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 944 time: 0.0917265
Jun 01 10:06:39.568661 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dde6e57d-044c-4cb5-8b8e-257b6130ad97 req-56c4732e-5ff0-4b21-bc4b-9c58078631b5 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0474250
Jun 01 10:06:39.578722 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:39.627607 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.provisioning_blocks [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Transition to ACTIVE for port object c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 will not be triggered until provisioned by entity DHCP. {{(pid=92565) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:39.629647 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a6973b74-cbfe-40d9-a9d2-c170f7cf12a7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:39.640902 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d8f3f62c-6a15-420d-a3fc-20066fe83a13 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:39.644762 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-d8f3f62c-6a15-420d-a3fc-20066fe83a13 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/588b9948-61c7-460e-bb6d-1b7d359e0aa3 HTTP/1.1" status: 204  len: 168 time: 0.9098678
Jun 01 10:06:39.721311 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a6973b74-cbfe-40d9-a9d2-c170f7cf12a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:39.733789 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-df5258fc-74ee-478b-a7ae-d088edc2b775 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:39.764514 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:39.788328 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-a6973b74-cbfe-40d9-a9d2-c170f7cf12a7 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=5a22978db88049c097554bcb8fd0c098&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9417605
Jun 01 10:06:39.791220 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 57752) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:39.793506 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6973b74-cbfe-40d9-a9d2-c170f7cf12a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=54180a02-f1e2-4505-8717-afc095f47b05,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:39.800550 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a6973b74-cbfe-40d9-a9d2-c170f7cf12a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:39.801031 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.015s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:39.848284 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Network 3d9ff4d3-b145-4108-a593-976a9cfb63dc is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:39.853511 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-bb568e75-3922-45cd-8a43-3a4c7036bc61 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:39.856301 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:39.860696 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:06:39.866979 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:39.867612 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:39.881370 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-bb568e75-3922-45cd-8a43-3a4c7036bc61 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:39.894548 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event updated for resources: {'Port': ['ID=c4b8d4ae-e9e9-4d40-a923-e03752a7ad32,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:39.898683 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:39.962952 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.0056102
Jun 01 10:06:40.014587 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-bb568e75-3922-45cd-8a43-3a4c7036bc61 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:40.028904 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b1547fab-727a-47ce-b5c5-9294dc4e52f2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:40.045837 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb568e75-3922-45cd-8a43-3a4c7036bc61 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54180a02-f1e2-4505-8717-afc095f47b05,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:40.052269 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-bb568e75-3922-45cd-8a43-3a4c7036bc61 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:40.111877 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-bb568e75-3922-45cd-8a43-3a4c7036bc61 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:40.116177 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-bb568e75-3922-45cd-8a43-3a4c7036bc61 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/54180a02-f1e2-4505-8717-afc095f47b05 HTTP/1.1" status: 204  len: 168 time: 0.3239679
Jun 01 10:06:40.158588 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dd33bb2-2cbc-42de-ac5d-ec413ab88abd req-78c99e95-f15e-4088-9fff-c03e2a273472 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:40.160112 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6dd33bb2-2cbc-42de-ac5d-ec413ab88abd req-78c99e95-f15e-4088-9fff-c03e2a273472 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 931 time: 0.1099477
Jun 01 10:06:40.207429 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6dd33bb2-2cbc-42de-ac5d-ec413ab88abd req-f6d5c066-0a76-4f21-b881-20986881f176 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405819
Jun 01 10:06:40.222696 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-cf451e7b-33e3-48f0-8584-ac6a781fab7f None None] Provisioning for port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:40.237826 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-cf451e7b-33e3-48f0-8584-ac6a781fab7f None None] Provisioning complete for port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:40.238578 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cf451e7b-33e3-48f0-8584-ac6a781fab7f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:40.296038 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-cf451e7b-33e3-48f0-8584-ac6a781fab7f None None] Port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:06:40.325046 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-034e3a80-5d8d-4abe-bb94-dbc846ad2819 req-718f2dec-c3b0-4ef3-b088-46371a70b2e9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 210 time: 0.0578568
Jun 01 10:06:40.447266 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb804e6c-a8b4-4c40-84c1-e49003341484 req-d69876e3-4b95-4ea3-b4a0-1218fa552032 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:40.448729 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cb804e6c-a8b4-4c40-84c1-e49003341484 req-d69876e3-4b95-4ea3-b4a0-1218fa552032 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 945 time: 0.0837405
Jun 01 10:06:40.470194 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8b622beb-4a6b-478f-a237-0458c4239389 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:40.497133 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cb804e6c-a8b4-4c40-84c1-e49003341484 req-3d5c7931-6402-45b1-bb70-06319b584fe2 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0426650
Jun 01 10:06:40.766224 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e11bbccc-63c1-45cb-adca-7f8b9feaefc5 req-853b8987-f74b-42d3-8466-e2d851f9ac03 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:40.767709 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e11bbccc-63c1-45cb-adca-7f8b9feaefc5 req-853b8987-f74b-42d3-8466-e2d851f9ac03 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 944 time: 0.0898733
Jun 01 10:06:40.814681 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e11bbccc-63c1-45cb-adca-7f8b9feaefc5 req-7268406d-932b-4839-99e9-1a7c22004d50 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406029
Jun 01 10:06:40.825482 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 57794) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:40.843431 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-894a1d55-1425-4565-9394-a08c75447143 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:40.859876 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-894a1d55-1425-4565-9394-a08c75447143 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:40.864340 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-894a1d55-1425-4565-9394-a08c75447143 admin admin] Usage tracker for resource:security_group_rule and tenant:9282815df1034f8ab5db5ba43fb48f9b is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:40.868321 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-894a1d55-1425-4565-9394-a08c75447143 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:40.876677 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-894a1d55-1425-4565-9394-a08c75447143 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:40.973846 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-894a1d55-1425-4565-9394-a08c75447143 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:41.034004 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-894a1d55-1425-4565-9394-a08c75447143 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:41.042803 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:41.085292 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-894a1d55-1425-4565-9394-a08c75447143 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=9282815df1034f8ab5db5ba43fb48f9b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2587259
Jun 01 10:06:41.086274 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-894a1d55-1425-4565-9394-a08c75447143 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07536c75-7a00-4c43-90db-ab0abf88db45,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:41.087875 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 57806) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:41.090896 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-894a1d55-1425-4565-9394-a08c75447143 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:41.159944 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b54b1fa7-5a89-40b1-9575-8acbf53b7960 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:41.186542 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b54b1fa7-5a89-40b1-9575-8acbf53b7960 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:41.373434 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b54b1fa7-5a89-40b1-9575-8acbf53b7960 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:41.379132 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:41.392749 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b54b1fa7-5a89-40b1-9575-8acbf53b7960 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07536c75-7a00-4c43-90db-ab0abf88db45,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:41.397850 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b54b1fa7-5a89-40b1-9575-8acbf53b7960 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:41.401565 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b54b1fa7-5a89-40b1-9575-8acbf53b7960 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:41.406429 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-b54b1fa7-5a89-40b1-9575-8acbf53b7960 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/07536c75-7a00-4c43-90db-ab0abf88db45 HTTP/1.1" status: 204  len: 168 time: 0.3131595
Jun 01 10:06:41.408554 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-627a9c84-b65b-4c2d-b288-58820754272e req-49bbd3ce-8de1-4d66-b68f-845fb634235f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:41.415387 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-627a9c84-b65b-4c2d-b288-58820754272e req-49bbd3ce-8de1-4d66-b68f-845fb634235f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 931 time: 0.0953782
Jun 01 10:06:41.496730 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-412051d7-ffcf-4d29-9608-5f8aaf2ba04c req-adb78cd9-a4b4-42e9-b9ce-4b5b30e734b1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 210 time: 0.0571980
Jun 01 10:06:41.511801 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-627a9c84-b65b-4c2d-b288-58820754272e req-90884487-e7d9-48aa-9ae6-26fea6b1f095 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0953445
Jun 01 10:06:41.686864 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfbaf54b-dc94-4255-8ade-0c2a32096c1b req-950a95e1-aeea-4987-b13b-2c44a22b1d12 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:41.688363 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dfbaf54b-dc94-4255-8ade-0c2a32096c1b req-950a95e1-aeea-4987-b13b-2c44a22b1d12 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 945 time: 0.0846906
Jun 01 10:06:41.737023 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dfbaf54b-dc94-4255-8ade-0c2a32096c1b req-b9540042-7ace-402d-bcdf-d502266ae30f tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420072
Jun 01 10:06:42.041722 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Request body: {'port': {'device_id': '0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:42.100729 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-467084c1-a089-4833-b6fd-f92d52be4ab1 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ea668f76-dcbd-410c-a737-019b6396ac7f HTTP/1.1" status: 200  len: 217 time: 0.1511259
Jun 01 10:06:42.125550 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b46f46c-d001-4b61-8135-fed0927d4f76 req-50d4ffee-82f8-4fe9-bad3-ee84ff57cad8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:42.127108 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4b46f46c-d001-4b61-8135-fed0927d4f76 req-50d4ffee-82f8-4fe9-bad3-ee84ff57cad8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 944 time: 0.2042069
Jun 01 10:06:42.179932 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-561c3bda-2a16-4896-9f34-7e91f262db66 req-00afaba1-623f-4b3d-994a-7bc94ec7e553 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:42.179932 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-561c3bda-2a16-4896-9f34-7e91f262db66 req-00afaba1-623f-4b3d-994a-7bc94ec7e553 service neutron] 10.222.0.30 "GET /v2.0/networks?id=34268ce8-8baf-41d5-acbc-1b6c167dd481 HTTP/1.1" status: 200  len: 920 time: 0.2051485
Jun 01 10:06:42.180130 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-4156febe-7809-43a8-b513-ed8c0593d29d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:42.182126 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-4156febe-7809-43a8-b513-ed8c0593d29d service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2ee54c26-f286-4f9a-b791-24aa84feb26a HTTP/1.1" status: 200  len: 859 time: 0.0705216
Jun 01 10:06:42.262698 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-561c3bda-2a16-4896-9f34-7e91f262db66 req-ab78873a-8399-460f-885f-6bc967c7958c service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=18b5c352-ee0c-425b-a1bf-666d362844b9 HTTP/1.1" status: 200  len: 217 time: 0.0708554
Jun 01 10:06:42.280376 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4b46f46c-d001-4b61-8135-fed0927d4f76 req-a85f7410-3963-4d78-bbd2-70854a8f101e tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1322875
Jun 01 10:06:42.322184 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-80fff0bd-4aca-45c3-914e-3f600474cb6b service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=34268ce8-8baf-41d5-acbc-1b6c167dd481&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1310949
Jun 01 10:06:42.352626 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-561c3bda-2a16-4896-9f34-7e91f262db66 req-616c62b6-0064-489f-856d-1f4c795744c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:42.354081 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-561c3bda-2a16-4896-9f34-7e91f262db66 req-616c62b6-0064-489f-856d-1f4c795744c1 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2ee54c26-f286-4f9a-b791-24aa84feb26a HTTP/1.1" status: 200  len: 859 time: 0.0728607
Jun 01 10:06:42.370831 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:42.402602 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.30', 60242) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:42.451806 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-561c3bda-2a16-4896-9f34-7e91f262db66 req-ccf44aae-a19a-4794-8425-55de58003827 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=34268ce8-8baf-41d5-acbc-1b6c167dd481&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0863099
Jun 01 10:06:42.608671 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-139029b1-eb79-48d7-8356-12bf65dbddaa service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2770753
Jun 01 10:06:42.811180 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-57931ca4-899b-4309-b71f-b60ffc1eb3b7 req-bb017ebf-ef55-47ac-ad04-06793fa5bf4d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 210 time: 0.0609841
Jun 01 10:06:42.950067 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b0de552e-ee16-4eb2-890b-ef30675ce4f0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:43.044050 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-561c3bda-2a16-4896-9f34-7e91f262db66 req-45a79d83-8d1f-49f7-ab24-ecdd3dc327af service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5809479
Jun 01 10:06:43.062326 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4c641b05-cd62-4c49-ae17-4487c2bb73f6 req-0521801f-2bd6-41de-8de5-a826c618692e service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4450173
Jun 01 10:06:43.088725 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63864984-9966-4ebe-912e-1a45bd910dfd req-3970e12c-876e-4a96-b5da-d0793f076ac9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:43.090383 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-63864984-9966-4ebe-912e-1a45bd910dfd req-3970e12c-876e-4a96-b5da-d0793f076ac9 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 1098 time: 0.6816239
Jun 01 10:06:43.185551 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-63864984-9966-4ebe-912e-1a45bd910dfd req-a85c2d57-4786-4825-82b6-5dcf42d903a9 service neutron] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:43.212103 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 {{(pid=92565) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:06:43.220742 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-63864984-9966-4ebe-912e-1a45bd910dfd req-a85c2d57-4786-4825-82b6-5dcf42d903a9 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:43.230438 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e18799a9-82b9-4890-9e6a-76849714a75a req-3c89ff58-6ecb-4650-b278-2553567ad8dc tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:43.231883 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e18799a9-82b9-4890-9e6a-76849714a75a req-3c89ff58-6ecb-4650-b278-2553567ad8dc tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 931 time: 0.4955139
Jun 01 10:06:43.236092 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:43.240953 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-63864984-9966-4ebe-912e-1a45bd910dfd req-a85c2d57-4786-4825-82b6-5dcf42d903a9 service neutron] Usage tracker for resource:security_group_rule and tenant:fa2a1f8cdcd643dfbe904612d65dc770 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:43.261543 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-63864984-9966-4ebe-912e-1a45bd910dfd req-a85c2d57-4786-4825-82b6-5dcf42d903a9 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:43.278507 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:43.303992 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34d148da-13ba-47e6-925d-68eeb19e3e6b req-99f4f6c9-3a70-45b0-bfa0-4d6413316575 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:43.303992 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34d148da-13ba-47e6-925d-68eeb19e3e6b req-99f4f6c9-3a70-45b0-bfa0-4d6413316575 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 945 time: 0.3428426
Jun 01 10:06:43.303992 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-63864984-9966-4ebe-912e-1a45bd910dfd req-a85c2d57-4786-4825-82b6-5dcf42d903a9 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:43.364417 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feb32c74-bbe2-400c-b533-cafae43aef20 req-4b3d81dc-4d65-4bfb-8352-e169e4026169 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:43.366365 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-feb32c74-bbe2-400c-b533-cafae43aef20 req-4b3d81dc-4d65-4bfb-8352-e169e4026169 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=ef4bc75ba53a44cca2e4b7c2b8aeb818&device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 1097 time: 0.1478467
Jun 01 10:06:43.375397 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-561c3bda-2a16-4896-9f34-7e91f262db66 req-8b064b08-8781-4bc9-a557-a84864263b54 service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3203933
Jun 01 10:06:43.393395 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e18799a9-82b9-4890-9e6a-76849714a75a req-fbdf6359-3b7e-4cfa-a474-cc77246832da tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1483619
Jun 01 10:06:43.410210 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34d148da-13ba-47e6-925d-68eeb19e3e6b req-a482a5aa-b786-494d-b1ab-3869ffdca36a tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1001992
Jun 01 10:06:43.490376 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-63864984-9966-4ebe-912e-1a45bd910dfd req-a85c2d57-4786-4825-82b6-5dcf42d903a9 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:43.502155 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.provisioning_blocks [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Transition to ACTIVE for port object c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 will not be triggered until provisioned by entity L2. {{(pid=92565) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:43.586535 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feb32c74-bbe2-400c-b533-cafae43aef20 req-8ad46564-f53f-4558-b0dd-14573207bcca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:43.588137 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-feb32c74-bbe2-400c-b533-cafae43aef20 req-8ad46564-f53f-4558-b0dd-14573207bcca service neutron] 10.222.0.30 "GET /v2.0/networks?id=34268ce8-8baf-41d5-acbc-1b6c167dd481 HTTP/1.1" status: 200  len: 920 time: 0.2143023
Jun 01 10:06:43.590198 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:43.596376 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-bcded5df-fb2c-452b-8e4a-016d1954bde8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:43.622138 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-63864984-9966-4ebe-912e-1a45bd910dfd req-a85c2d57-4786-4825-82b6-5dcf42d903a9 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:43.684258 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Pushing event updated for resources: {'Port': ['ID=c4b8d4ae-e9e9-4d40-a923-e03752a7ad32,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:43.688346 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-4c1e3975-1c23-4a7e-9e4c-97114178fbc0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:43.768706 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:43.781938 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a85c2d57-4786-4825-82b6-5dcf42d903a9 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=ea752b67-0971-4af6-a9d0-b97f5e740997,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:43.785516 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-feb32c74-bbe2-400c-b533-cafae43aef20 req-db0edb56-4a1b-4643-9533-f5f026a80b39 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ea668f76-dcbd-410c-a737-019b6396ac7f HTTP/1.1" status: 200  len: 217 time: 0.1043401
Jun 01 10:06:43.786749 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a85c2d57-4786-4825-82b6-5dcf42d903a9 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:43.789129 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-63864984-9966-4ebe-912e-1a45bd910dfd req-a85c2d57-4786-4825-82b6-5dcf42d903a9 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6838512
Jun 01 10:06:43.869538 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34f953ae-828b-43db-912d-0edf89356e65 req-660be776-2832-443a-a472-50c97bbafedc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:43.871155 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34f953ae-828b-43db-912d-0edf89356e65 req-660be776-2832-443a-a472-50c97bbafedc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.30 "GET /v2.0/networks?id=be546533-cf92-483d-9e38-7d14ca9c4902 HTTP/1.1" status: 200  len: 816 time: 0.3419864
Jun 01 10:06:43.888250 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08347eed-b963-4179-8c78-230f5a6b14c7 req-1cb741cf-e913-4bd5-a911-f51147b1c00c tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:43.893698 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-08347eed-b963-4179-8c78-230f5a6b14c7 req-1cb741cf-e913-4bd5-a911-f51147b1c00c tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 944 time: 0.3250730
Jun 01 10:06:43.933271 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 18b5c352-ee0c-425b-a1bf-666d362844b9 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:06:44.157649 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-08347eed-b963-4179-8c78-230f5a6b14c7 req-ecc5a544-4678-49ea-8031-267c23db3dba tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2494175
Jun 01 10:06:44.159192 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Attempting to bind port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:06:44.159687 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Attempting to bind port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '2f350557-5423-4a12-a64b-0bf55f2578e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc'}] {{(pid=92565) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:06:44.160202 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Attempting to bind port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 on network 3d9ff4d3-b145-4108-a593-976a9cfb63dc {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:44.165337 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feb32c74-bbe2-400c-b533-cafae43aef20 req-9d5f9f06-0738-4938-bb42-7e731ec2b785 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:44.167072 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-feb32c74-bbe2-400c-b533-cafae43aef20 req-9d5f9f06-0738-4938-bb42-7e731ec2b785 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2ee54c26-f286-4f9a-b791-24aa84feb26a HTTP/1.1" status: 200  len: 859 time: 0.2051988
Jun 01 10:06:44.169108 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 on network 3d9ff4d3-b145-4108-a593-976a9cfb63dc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:06:44.169620 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Attempting to bind port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 on network 3d9ff4d3-b145-4108-a593-976a9cfb63dc {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:44.177577 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 6, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:06:44.178100 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Checking segment: {'id': '2f350557-5423-4a12-a64b-0bf55f2578e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92565) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:06:44.178635 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Bound using segment: {'id': '2f350557-5423-4a12-a64b-0bf55f2578e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc'} {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:06:44.179280 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Bound port: c4b8d4ae-e9e9-4d40-a923-e03752a7ad32, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2f350557-5423-4a12-a64b-0bf55f2578e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc'}}] {{(pid=92565) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:06:44.179823 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:44.191040 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:44.196449 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fd502907-bc6f-4e92-a554-bbe6827e563e req-02f7444c-ba5a-42f8-8004-71435e192ba0 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 210 time: 0.1835954
Jun 01 10:06:44.238996 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-feb32c74-bbe2-400c-b533-cafae43aef20 req-4eb11272-1f9d-4543-8ed6-e79d13dbec4c service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=34268ce8-8baf-41d5-acbc-1b6c167dd481&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0619333
Jun 01 10:06:44.250884 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34f953ae-828b-43db-912d-0edf89356e65 req-eac84af2-a5aa-4dfd-aa0f-b28cf01b962d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f4f6f875519045a39c1fdbadd53ce517 HTTP/1.1" status: 200  len: 380 time: 0.3486543
Jun 01 10:06:44.269091 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-34f953ae-828b-43db-912d-0edf89356e65 req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Request body: {'port': {'device_id': '77032f84-7f38-4e7e-b0fd-accc20754797', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'admin_state_up': True, 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'security_groups': ['325ff63e-d052-497f-a7db-055e207d9f35']}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:44.303142 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 18b5c352-ee0c-425b-a1bf-666d362844b9, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=18b5c352-ee0c-425b-a1bf-666d362844b9,segment=NetworkSegment(3982460c-82d6-48e1-a5bd-5d7cbbe910af),segment_id=3982460c-82d6-48e1-a5bd-5d7cbbe910af)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:44.322550 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': '18b5c352-ee0c-425b-a1bf-666d362844b9', 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481', 'port_id': '18b5c352-ee0c-425b-a1bf-666d362844b9', 'mac_address': 'fa:16:3e:a4:f9:8d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 859, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2ee54c26-f286-4f9a-b791-24aa84feb26a', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:06:44.382243 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:44.403437 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 18b5c352-ee0c-425b-a1bf-666d362844b9 {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:06:44.432868 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 18b5c352-ee0c-425b-a1bf-666d362844b9, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=18b5c352-ee0c-425b-a1bf-666d362844b9,segment=NetworkSegment(3982460c-82d6-48e1-a5bd-5d7cbbe910af),segment_id=3982460c-82d6-48e1-a5bd-5d7cbbe910af)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:44.443657 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] For port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32, host hv-cinder-78726, cleared binding levels {{(pid=92565) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:06:44.477826 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-34f953ae-828b-43db-912d-0edf89356e65 req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:44.509522 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-34f953ae-828b-43db-912d-0edf89356e65 req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:44.521858 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:44.524024 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-99e87755-dd8f-4ad9-97bb-51f119d41410 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:44.554356 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-feb32c74-bbe2-400c-b533-cafae43aef20 req-af0b4657-3221-48cd-accf-a71da1a1f757 service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2825170
Jun 01 10:06:44.556336 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] For port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c4b8d4ae-e9e9-4d40-a923-e03752a7ad32,segment=NetworkSegment(2f350557-5423-4a12-a64b-0bf55f2578e6),segment_id=2f350557-5423-4a12-a64b-0bf55f2578e6)] {{(pid=92565) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:06:44.633551 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-34f953ae-828b-43db-912d-0edf89356e65 req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Made reservation on behalf of f4f6f875519045a39c1fdbadd53ce517 for: {'port': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:06:44.638631 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-34f953ae-828b-43db-912d-0edf89356e65 req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:44.676007 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=18b5c352-ee0c-425b-a1bf-666d362844b9,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:44.688450 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:44.711031 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:44.724539 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:44.780812 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['18b5c352-ee0c-425b-a1bf-666d362844b9'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:06:44.796901 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:44.797519 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:44.798877 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] 10.222.0.30 "PUT /v2.0/ports/c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 HTTP/1.1" status: 200  len: 1093 time: 2.7633414
Jun 01 10:06:44.827463 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3', 'tag': 'c4b8d4ae-e9e9-4d40-a923-e03752a7ad32'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:06:44.830010 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1a4c2750-416a-4c66-ad40-06762fd60f81" -d '{"events": [{"name": "network-changed", "server_uuid": "0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3", "tag": "c4b8d4ae-e9e9-4d40-a923-e03752a7ad32"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:06:44.832782 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Pushing event updated for resources: {'Port': ['ID=c4b8d4ae-e9e9-4d40-a923-e03752a7ad32,revision_number=3']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:44.852171 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:44.890850 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-feb32c74-bbe2-400c-b533-cafae43aef20 req-1ea530ff-4855-4f74-b57f-4c2f4b6d9705 service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3331392
Jun 01 10:06:44.938531 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4a0e667-b868-4e26-858d-a2279a0e7b3c req-9bf1e520-0e8d-4f84-b5a2-771bb668a215 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:44.940095 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a4a0e667-b868-4e26-858d-a2279a0e7b3c req-9bf1e520-0e8d-4f84-b5a2-771bb668a215 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 943 time: 0.3535328
Jun 01 10:06:44.965566 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efc961d4-a2f9-4bbe-8baf-3f55aba96ded req-467f2ea2-ebf1-489b-b4a4-800ecd12442e tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:44.968539 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-efc961d4-a2f9-4bbe-8baf-3f55aba96ded req-467f2ea2-ebf1-489b-b4a4-800ecd12442e tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 945 time: 0.3435144
Jun 01 10:06:45.035421 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [req-34f953ae-828b-43db-912d-0edf89356e65 req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Allocated IP 172.20.0.10 (be546533-cf92-483d-9e38-7d14ca9c4902/f2fdda64-a03c-41d7-8178-daca0363bd6e/ba4fa832-87bd-477b-bad8-2837ab09304a) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:06:45.040561 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-c8890722-1d54-4916-8d52-d624d369c5aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:45.043037 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-c8890722-1d54-4916-8d52-d624d369c5aa service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=d13dc1de700d428a8982ca87f11948d0&device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 1096 time: 0.0951798
Jun 01 10:06:45.095015 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a4a0e667-b868-4e26-858d-a2279a0e7b3c req-8f32a0ef-e356-4b33-87ea-ef65959dd0c4 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1173728
Jun 01 10:06:45.107248 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-efc961d4-a2f9-4bbe-8baf-3f55aba96ded req-abd74426-0652-4c56-be77-c713bc0f1f6a tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1249959
Jun 01 10:06:45.195935 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-f709e692-aa34-4520-8fe5-6c126f904400 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 HTTP/1.1" status: 200  len: 217 time: 0.1414824
Jun 01 10:06:45.427696 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:06:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2e11fb26-5ffc-4b18-af98-d3dbf61aa20b x-openstack-request-id: req-2e11fb26-5ffc-4b18-af98-d3dbf61aa20b {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:06:45.428349 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3", "tag": "c4b8d4ae-e9e9-4d40-a923-e03752a7ad32", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:06:45.428349 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-2e11fb26-5ffc-4b18-af98-d3dbf61aa20b {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:06:45.428981 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3', 'tag': 'c4b8d4ae-e9e9-4d40-a923-e03752a7ad32', 'status': 'completed', 'code': 200}
Jun 01 10:06:45.430540 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-aadb01ba-6f0f-4ddd-932e-221c5238d352 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:45.432448 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-aadb01ba-6f0f-4ddd-932e-221c5238d352 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2a00a573-a4bb-4d2d-a3e6-7aef03966618 HTTP/1.1" status: 200  len: 849 time: 0.2268057
Jun 01 10:06:45.556714 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-afa7feed-f298-41b4-bd10-aa5e91b778f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:45.558377 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-afa7feed-f298-41b4-bd10-aa5e91b778f8 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=3d9ff4d3-b145-4108-a593-976a9cfb63dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1176028
Jun 01 10:06:45.601056 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d87050ee-4d17-4de5-a4c4-77436d109ba1 req-bb6eba0e-f66e-4fd1-9ccd-c09595642cad tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 210 time: 0.2129948
Jun 01 10:06:45.617546 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-34f953ae-828b-43db-912d-0edf89356e65 req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:45.638281 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-34f953ae-828b-43db-912d-0edf89356e65 req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Transition to ACTIVE for port object ba4fa832-87bd-477b-bad8-2837ab09304a will not be triggered until provisioned by entity DHCP. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:45.677862 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19b54fc-2871-45cb-a114-cafd5076a2cc req-f04f12a7-06f3-46a7-b78e-29f92326e471 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:45.679446 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a19b54fc-2871-45cb-a114-cafd5076a2cc req-f04f12a7-06f3-46a7-b78e-29f92326e471 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 944 time: 0.3047721
Jun 01 10:06:45.731397 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a19b54fc-2871-45cb-a114-cafd5076a2cc req-bd9e2ab0-de69-467f-bef9-c3a216804e9c tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0451500
Jun 01 10:06:45.740265 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-0b5eec96-5f0e-4879-988e-2f696db9facf service neutron] 10.222.0.30 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1731875
Jun 01 10:06:45.765622 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:45.766260 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-34f953ae-828b-43db-912d-0edf89356e65 req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:45.779721 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:45.848741 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-34f953ae-828b-43db-912d-0edf89356e65 req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Network be546533-cf92-483d-9e38-7d14ca9c4902 is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:06:45.851835 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [req-34f953ae-828b-43db-912d-0edf89356e65 req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:06:45.855888 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-34f953ae-828b-43db-912d-0edf89356e65 req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:06:45.870145 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34f953ae-828b-43db-912d-0edf89356e65 req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:45.870812 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-34f953ae-828b-43db-912d-0edf89356e65 req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:45.888055 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event updated for resources: {'Port': ['ID=ba4fa832-87bd-477b-bad8-2837ab09304a,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:45.892117 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:45.990097 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 57986) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:46.010831 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34f953ae-828b-43db-912d-0edf89356e65 req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.7539284
Jun 01 10:06:46.137374 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-cf611ee0-2acf-4f6b-9ab6-1264ac7ef5e1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:46.154445 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-cf611ee0-2acf-4f6b-9ab6-1264ac7ef5e1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:46.159594 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-cf611ee0-2acf-4f6b-9ab6-1264ac7ef5e1 admin admin] Usage tracker for resource:security_group_rule and tenant:c38ef9e063c34374833408d0fe2d44f9 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:46.163051 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-cf611ee0-2acf-4f6b-9ab6-1264ac7ef5e1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:46.169440 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-cf611ee0-2acf-4f6b-9ab6-1264ac7ef5e1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:46.213125 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-947ae196-3d36-4ad3-95bd-88a5940e593b None None] Provisioning for port ba4fa832-87bd-477b-bad8-2837ab09304a completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:46.218064 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-947ae196-3d36-4ad3-95bd-88a5940e593b None None] Provisioning complete for port ba4fa832-87bd-477b-bad8-2837ab09304a triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:46.218697 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-947ae196-3d36-4ad3-95bd-88a5940e593b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:46.277516 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-947ae196-3d36-4ad3-95bd-88a5940e593b None None] Port ba4fa832-87bd-477b-bad8-2837ab09304a cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:06:46.332367 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-cf611ee0-2acf-4f6b-9ab6-1264ac7ef5e1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:46.400595 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98e41513-8547-492c-80ea-9dd26cb352b3 req-e8e0efba-48b3-4cf7-a3b9-a07db6c41a1f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:46.402061 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-98e41513-8547-492c-80ea-9dd26cb352b3 req-e8e0efba-48b3-4cf7-a3b9-a07db6c41a1f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 943 time: 0.1579132
Jun 01 10:06:46.413093 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73624b7b-841e-4b45-96a5-6d1245445bf0 req-bb786b77-98bf-402c-9935-8d625fd1bccd tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:46.414064 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-73624b7b-841e-4b45-96a5-6d1245445bf0 req-bb786b77-98bf-402c-9935-8d625fd1bccd tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 945 time: 0.1259496
Jun 01 10:06:46.434466 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-cf611ee0-2acf-4f6b-9ab6-1264ac7ef5e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:46.457354 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-5570c3a0-47a2-489b-bd65-e73dfc902513 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:46.502985 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 58018) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:46.537746 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-cf611ee0-2acf-4f6b-9ab6-1264ac7ef5e1 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=c38ef9e063c34374833408d0fe2d44f9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5465260
Jun 01 10:06:46.543489 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-98e41513-8547-492c-80ea-9dd26cb352b3 req-d46d8197-553e-4341-bcc7-95ec7a940e95 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1285238
Jun 01 10:06:46.544092 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf611ee0-2acf-4f6b-9ab6-1264ac7ef5e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=723d46d0-3518-44fe-95d9-d0d7490ad044,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:46.544938 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 58024) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:46.549013 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-cf611ee0-2acf-4f6b-9ab6-1264ac7ef5e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:46.555244 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-73624b7b-841e-4b45-96a5-6d1245445bf0 req-42371436-10a3-4eba-8eea-c2e688da9934 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1103313
Jun 01 10:06:46.632854 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3ea8b1c5-3335-4be3-a0a3-61b4a6c23c08 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:46.678710 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3ea8b1c5-3335-4be3-a0a3-61b4a6c23c08 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:46.689356 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1696cfac-10f6-4e3f-9320-e0849d27c6a7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:46.719209 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-1696cfac-10f6-4e3f-9320-e0849d27c6a7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:46.744447 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-1696cfac-10f6-4e3f-9320-e0849d27c6a7 admin admin] Usage tracker for resource:security_group_rule and tenant:9d16579fb3934ff0a8bbb929b8ea29b0 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:46.749613 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-1696cfac-10f6-4e3f-9320-e0849d27c6a7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:46.756929 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-1696cfac-10f6-4e3f-9320-e0849d27c6a7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:46.844176 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8773127-157c-4175-8e3b-4d4783aabfa3 req-4495f289-6734-477f-8af3-988f7bdacefe tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:46.847071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-a8773127-157c-4175-8e3b-4d4783aabfa3 req-4495f289-6734-477f-8af3-988f7bdacefe tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Synchronizing usage tracker for tenant:f4f6f875519045a39c1fdbadd53ce517 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:06:46.868905 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3ea8b1c5-3335-4be3-a0a3-61b4a6c23c08 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:46.877056 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-6ae5c0bd-9b8d-4372-b791-db1e505d2430 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:46.895894 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ea8b1c5-3335-4be3-a0a3-61b4a6c23c08 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=723d46d0-3518-44fe-95d9-d0d7490ad044,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:46.896723 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-3ea8b1c5-3335-4be3-a0a3-61b4a6c23c08 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:46.925173 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3ea8b1c5-3335-4be3-a0a3-61b4a6c23c08 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:46.925173 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-3ea8b1c5-3335-4be3-a0a3-61b4a6c23c08 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/723d46d0-3518-44fe-95d9-d0d7490ad044 HTTP/1.1" status: 204  len: 168 time: 0.3772576
Jun 01 10:06:46.948863 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-a8773127-157c-4175-8e3b-4d4783aabfa3 req-4495f289-6734-477f-8af3-988f7bdacefe tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Unset dirty status for tenant:f4f6f875519045a39c1fdbadd53ce517 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:06:46.953976 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a8773127-157c-4175-8e3b-4d4783aabfa3 req-4495f289-6734-477f-8af3-988f7bdacefe tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 932 time: 0.2132537
Jun 01 10:06:46.970835 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2315e01-2b17-442f-811a-01b59cd54daa req-8f802aee-babc-4a17-8bdf-3f7551008cc3 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:46.972625 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e2315e01-2b17-442f-811a-01b59cd54daa req-8f802aee-babc-4a17-8bdf-3f7551008cc3 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 944 time: 0.1057398
Jun 01 10:06:47.000922 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1696cfac-10f6-4e3f-9320-e0849d27c6a7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:47.046052 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a8773127-157c-4175-8e3b-4d4783aabfa3 req-63e68c3d-5fe1-4d49-983d-daaa889e29c8 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0846982
Jun 01 10:06:47.050427 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e2315e01-2b17-442f-811a-01b59cd54daa req-f8fe9593-5db5-4818-b1b7-3476e505cca3 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0599716
Jun 01 10:06:47.108494 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1696cfac-10f6-4e3f-9320-e0849d27c6a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:47.118172 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-510e5161-7eed-45aa-bc99-ba3b934228d8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:47.158554 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-1696cfac-10f6-4e3f-9320-e0849d27c6a7 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=9d16579fb3934ff0a8bbb929b8ea29b0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6534731
Jun 01 10:06:47.162426 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 58056) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:47.165158 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1696cfac-10f6-4e3f-9320-e0849d27c6a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de209644-ea55-4afd-a3da-d03c6674536f,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:47.195715 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-1696cfac-10f6-4e3f-9320-e0849d27c6a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:47.241316 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f9d9fe87-69d2-4771-ab3e-ce86fb7ff9f6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:47.269252 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f9d9fe87-69d2-4771-ab3e-ce86fb7ff9f6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:47.498942 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f9d9fe87-69d2-4771-ab3e-ce86fb7ff9f6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:47.504402 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-270399ea-67ac-4ca2-828f-13497a8512a4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:47.517580 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9d9fe87-69d2-4771-ab3e-ce86fb7ff9f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=de209644-ea55-4afd-a3da-d03c6674536f,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:47.519896 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f9d9fe87-69d2-4771-ab3e-ce86fb7ff9f6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:47.528158 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f9d9fe87-69d2-4771-ab3e-ce86fb7ff9f6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:47.528158 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-f9d9fe87-69d2-4771-ab3e-ce86fb7ff9f6 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/de209644-ea55-4afd-a3da-d03c6674536f HTTP/1.1" status: 204  len: 168 time: 0.3618586
Jun 01 10:06:47.717545 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 58090) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:47.735719 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-12b52262-ea76-4f7f-a320-70c22d37ca03 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:47.751143 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-12b52262-ea76-4f7f-a320-70c22d37ca03 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:47.754947 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-12b52262-ea76-4f7f-a320-70c22d37ca03 admin admin] Usage tracker for resource:security_group_rule and tenant:e26492f5e6604036bac02f006f7f649f is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:47.757716 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-12b52262-ea76-4f7f-a320-70c22d37ca03 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:47.764029 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-12b52262-ea76-4f7f-a320-70c22d37ca03 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:47.764926 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e687a9-72cc-4c1b-b04a-71fc786be132 req-74cf6b6b-24c4-4b3a-88ee-d7f8f19a068b tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:47.766835 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c8e687a9-72cc-4c1b-b04a-71fc786be132 req-74cf6b6b-24c4-4b3a-88ee-d7f8f19a068b tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 943 time: 0.0909321
Jun 01 10:06:47.827842 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c8e687a9-72cc-4c1b-b04a-71fc786be132 req-f3c8e691-d6a3-48c8-b282-0d377e4844e5 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0548642
Jun 01 10:06:47.868684 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-12b52262-ea76-4f7f-a320-70c22d37ca03 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:47.937109 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-12b52262-ea76-4f7f-a320-70c22d37ca03 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:47.946719 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:47.986619 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-12b52262-ea76-4f7f-a320-70c22d37ca03 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=e26492f5e6604036bac02f006f7f649f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2680087
Jun 01 10:06:47.988906 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12b52262-ea76-4f7f-a320-70c22d37ca03 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=19c7376c-20d7-405f-b8c0-255130a1a19b,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:47.990179 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 58104) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:47.992612 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-12b52262-ea76-4f7f-a320-70c22d37ca03 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:48.047600 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-36f63b2c-3170-42f0-b7f0-4df781ec4d4c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:48.073806 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-36f63b2c-3170-42f0-b7f0-4df781ec4d4c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:48.213700 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-36f63b2c-3170-42f0-b7f0-4df781ec4d4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:48.250152 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 58116) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:48.259368 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-bb568e75-3922-45cd-8a43-3a4c7036bc61 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:48.271602 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b34bcb89-a4b7-4486-b6b0-8cf32912b843 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:48.286573 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-b34bcb89-a4b7-4486-b6b0-8cf32912b843 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:48.290492 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-b34bcb89-a4b7-4486-b6b0-8cf32912b843 admin admin] Usage tracker for resource:security_group_rule and tenant:c9346f11093c46d4b9af08e9dece3f45 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:48.291587 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36f63b2c-3170-42f0-b7f0-4df781ec4d4c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=19c7376c-20d7-405f-b8c0-255130a1a19b,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:48.293890 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-b34bcb89-a4b7-4486-b6b0-8cf32912b843 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:48.295059 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-36f63b2c-3170-42f0-b7f0-4df781ec4d4c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:48.300511 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-b34bcb89-a4b7-4486-b6b0-8cf32912b843 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:48.318784 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-36f63b2c-3170-42f0-b7f0-4df781ec4d4c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:48.319425 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-36f63b2c-3170-42f0-b7f0-4df781ec4d4c admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/19c7376c-20d7-405f-b8c0-255130a1a19b HTTP/1.1" status: 204  len: 168 time: 0.3282487
Jun 01 10:06:48.359963 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e33503d-9c8d-4859-a9be-30743ff21320 req-90c1e98a-4ec9-4cec-9f52-a21a10642e04 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:48.361425 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3e33503d-9c8d-4859-a9be-30743ff21320 req-90c1e98a-4ec9-4cec-9f52-a21a10642e04 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 944 time: 0.1543000
Jun 01 10:06:48.369859 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb139abb-83f6-4309-b0ad-38bea5bb3749 req-0864855b-22d9-4a1e-a3db-7682fb6e5cb8 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:48.371376 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cb139abb-83f6-4309-b0ad-38bea5bb3749 req-0864855b-22d9-4a1e-a3db-7682fb6e5cb8 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 932 time: 0.2039595
Jun 01 10:06:48.398935 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b34bcb89-a4b7-4486-b6b0-8cf32912b843 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:48.437918 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3e33503d-9c8d-4859-a9be-30743ff21320 req-5587930e-7705-4702-85f1-3b63ec2d88ef tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0655444
Jun 01 10:06:48.450225 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cb139abb-83f6-4309-b0ad-38bea5bb3749 req-09a21bc5-9e25-471e-8e41-db8f2ed1a407 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0620475
Jun 01 10:06:48.474315 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b34bcb89-a4b7-4486-b6b0-8cf32912b843 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:48.483442 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:48.523254 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-b34bcb89-a4b7-4486-b6b0-8cf32912b843 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=c9346f11093c46d4b9af08e9dece3f45&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2719693
Jun 01 10:06:48.524231 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b34bcb89-a4b7-4486-b6b0-8cf32912b843 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=53be1d5a-5b3d-461d-8025-9a5282afc1de,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:48.525817 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 58122) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:48.527844 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b34bcb89-a4b7-4486-b6b0-8cf32912b843 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:48.591427 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2b607bb4-1650-4e1c-b9b6-0f4dd8287167 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:48.621011 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2b607bb4-1650-4e1c-b9b6-0f4dd8287167 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:48.669692 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device ea668f76-dcbd-410c-a737-019b6396ac7f details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:06:48.689119 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Request body: {'port': {'device_id': '77032f84-7f38-4e7e-b0fd-accc20754797', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:06:48.716800 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 58132) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:48.832536 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:48.888689 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2b607bb4-1650-4e1c-b9b6-0f4dd8287167 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:48.904430 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-cf611ee0-2acf-4f6b-9ab6-1264ac7ef5e1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:48.917650 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-e75cfa64-6f7f-416c-80ef-750f1957218b service neutron] 10.222.0.30 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2378688
Jun 01 10:06:48.928546 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2b607bb4-1650-4e1c-b9b6-0f4dd8287167 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:48.929901 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-2b607bb4-1650-4e1c-b9b6-0f4dd8287167 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/53be1d5a-5b3d-461d-8025-9a5282afc1de HTTP/1.1" status: 204  len: 168 time: 0.4022000
Jun 01 10:06:48.934847 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port ea668f76-dcbd-410c-a737-019b6396ac7f, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ea668f76-dcbd-410c-a737-019b6396ac7f,segment=NetworkSegment(3982460c-82d6-48e1-a5bd-5d7cbbe910af),segment_id=3982460c-82d6-48e1-a5bd-5d7cbbe910af)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:48.935328 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b607bb4-1650-4e1c-b9b6-0f4dd8287167 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=53be1d5a-5b3d-461d-8025-9a5282afc1de,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:48.940084 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-2b607bb4-1650-4e1c-b9b6-0f4dd8287167 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:48.971025 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': 'ea668f76-dcbd-410c-a737-019b6396ac7f', 'network_id': '34268ce8-8baf-41d5-acbc-1b6c167dd481', 'port_id': 'ea668f76-dcbd-410c-a737-019b6396ac7f', 'mac_address': 'fa:16:3e:be:60:26', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 859, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2ee54c26-f286-4f9a-b791-24aa84feb26a', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:06:49.064993 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:49.097772 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ea668f76-dcbd-410c-a737-019b6396ac7f {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:06:49.109064 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7b05623e-e680-4c87-ae55-8ade56bd349a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:49.114752 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port ea668f76-dcbd-410c-a737-019b6396ac7f, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ea668f76-dcbd-410c-a737-019b6396ac7f,segment=NetworkSegment(3982460c-82d6-48e1-a5bd-5d7cbbe910af),segment_id=3982460c-82d6-48e1-a5bd-5d7cbbe910af)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:49.138320 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-7b05623e-e680-4c87-ae55-8ade56bd349a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:49.147202 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-7b05623e-e680-4c87-ae55-8ade56bd349a admin admin] Usage tracker for resource:security_group_rule and tenant:cbb30af894bc4f6b98b270f72dd8b51d is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:49.150844 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-7b05623e-e680-4c87-ae55-8ade56bd349a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:49.159473 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-7b05623e-e680-4c87-ae55-8ade56bd349a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:49.191972 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a4c2750-416a-4c66-ad40-06762fd60f81 req-0caec885-d39a-449f-8f6c-940ba6e2e893 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:49.194002 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-1a4c2750-416a-4c66-ad40-06762fd60f81 req-0caec885-d39a-449f-8f6c-940ba6e2e893 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=d13dc1de700d428a8982ca87f11948d0&device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 1096 time: 0.1446483
Jun 01 10:06:49.218362 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:49.220648 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-99e87755-dd8f-4ad9-97bb-51f119d41410 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:49.233548 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a75b56e8-d149-4fc5-a603-a4e2d2c27601 req-c447e792-1c23-49ca-b551-354eeb90f936 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:49.241144 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a75b56e8-d149-4fc5-a603-a4e2d2c27601 req-c447e792-1c23-49ca-b551-354eeb90f936 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 943 time: 0.2021155
Jun 01 10:06:49.308947 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a75b56e8-d149-4fc5-a603-a4e2d2c27601 req-d8c80529-b7ae-4216-a8fc-0d2a3f4c8b9d tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0657635
Jun 01 10:06:49.374446 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=ea668f76-dcbd-410c-a737-019b6396ac7f,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:49.379035 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:49.420068 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7b05623e-e680-4c87-ae55-8ade56bd349a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:49.424774 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a4c2750-416a-4c66-ad40-06762fd60f81 req-953b2e7b-ce9f-4fce-b156-ad69db68265a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:49.426261 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-1a4c2750-416a-4c66-ad40-06762fd60f81 req-953b2e7b-ce9f-4fce-b156-ad69db68265a service neutron] 10.222.0.30 "GET /v2.0/networks?id=3d9ff4d3-b145-4108-a593-976a9cfb63dc HTTP/1.1" status: 200  len: 911 time: 0.2237678
Jun 01 10:06:49.480791 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ba4fa832-87bd-477b-bad8-2837ab09304a {{(pid=92566) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:06:49.487733 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['ea668f76-dcbd-410c-a737-019b6396ac7f'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:06:49.499323 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:49.501167 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-1a4c2750-416a-4c66-ad40-06762fd60f81 req-66132c4d-f77a-465c-b584-c41d4d522715 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 HTTP/1.1" status: 200  len: 217 time: 0.0677083
Jun 01 10:06:49.502375 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7b05623e-e680-4c87-ae55-8ade56bd349a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:49.532469 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:49.535707 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Transition to ACTIVE for port object ba4fa832-87bd-477b-bad8-2837ab09304a will not be triggered until provisioned by entity L2. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:06:49.550536 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-7b05623e-e680-4c87-ae55-8ade56bd349a admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=cbb30af894bc4f6b98b270f72dd8b51d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8302922
Jun 01 10:06:49.551756 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 58166) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:49.612917 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b05623e-e680-4c87-ae55-8ade56bd349a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7b9c8026-940a-4d17-9e55-6d8b1ffb3d1d,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:49.618282 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 18b5c352-ee0c-425b-a1bf-666d362844b9 up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:49.618448 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7b05623e-e680-4c87-ae55-8ade56bd349a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:49.628403 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a4c2750-416a-4c66-ad40-06762fd60f81 req-a4c34a85-693f-4bad-a6a6-aad246647755 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:49.630513 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-1a4c2750-416a-4c66-ad40-06762fd60f81 req-a4c34a85-693f-4bad-a6a6-aad246647755 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2a00a573-a4bb-4d2d-a3e6-7aef03966618 HTTP/1.1" status: 200  len: 849 time: 0.0986409
Jun 01 10:06:49.638431 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:49.693424 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:49.743096 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a4c2750-416a-4c66-ad40-06762fd60f81 req-0bb2a6af-ea27-4f7a-8474-99b6e3f42ac3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:49.751304 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-1a4c2750-416a-4c66-ad40-06762fd60f81 req-0bb2a6af-ea27-4f7a-8474-99b6e3f42ac3 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=3d9ff4d3-b145-4108-a593-976a9cfb63dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1133199
Jun 01 10:06:49.855123 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1960752-eebb-49be-a422-303a95820699 service neutron] Pushing event updated for resources: {'Port': ['ID=ba4fa832-87bd-477b-bad8-2837ab09304a,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:49.869508 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f1960752-eebb-49be-a422-303a95820699 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:49.937255 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-1a4c2750-416a-4c66-ad40-06762fd60f81 req-7cd00a23-3143-45e8-af28-8b45cc9800f2 service neutron] 10.222.0.30 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1768959
Jun 01 10:06:49.980994 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port 18b5c352-ee0c-425b-a1bf-666d362844b9 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:49.986791 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port 18b5c352-ee0c-425b-a1bf-666d362844b9 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:49.987194 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:50.003090 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-e4047c82-b8e6-4c99-8672-ea084f35ea8b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:50.173778 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-1a4c2750-416a-4c66-ad40-06762fd60f81 req-d5c83031-5c16-42ca-9910-f71f77e08d38 service neutron] 10.222.0.30 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2275627
Jun 01 10:06:50.191938 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-e4047c82-b8e6-4c99-8672-ea084f35ea8b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:50.232075 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Attempting to bind port ba4fa832-87bd-477b-bad8-2837ab09304a on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:06:50.232404 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Attempting to bind port ba4fa832-87bd-477b-bad8-2837ab09304a by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '718fdfa6-b13d-46f9-85ca-8438bc5d308c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902'}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:06:50.232736 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Attempting to bind port ba4fa832-87bd-477b-bad8-2837ab09304a on network be546533-cf92-483d-9e38-7d14ca9c4902 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:50.252014 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:50.270974 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Port ba4fa832-87bd-477b-bad8-2837ab09304a on network be546533-cf92-483d-9e38-7d14ca9c4902 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:06:50.271586 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Attempting to bind port ba4fa832-87bd-477b-bad8-2837ab09304a on network be546533-cf92-483d-9e38-7d14ca9c4902 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:06:50.286671 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '28696956-78ff-4e48-8a25-b702828c16d5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '18b5c352-ee0c-425b-a1bf-666d362844b9'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:06:50.289604 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee27b04f-3dc0-48cf-a2db-bfb4c568c622" -d '{"events": [{"server_uuid": "28696956-78ff-4e48-8a25-b702828c16d5", "name": "network-vif-plugged", "status": "completed", "tag": "18b5c352-ee0c-425b-a1bf-666d362844b9"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:06:50.298894 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 18b5c352-ee0c-425b-a1bf-666d362844b9, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=18b5c352-ee0c-425b-a1bf-666d362844b9,segment=NetworkSegment(3982460c-82d6-48e1-a5bd-5d7cbbe910af),segment_id=3982460c-82d6-48e1-a5bd-5d7cbbe910af)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:50.304177 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0b0905c-f0d0-47b2-94b3-a37ac4368b0a req-ef8ecf6a-2163-480f-ab47-fba3f932b382 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:50.311144 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b0b0905c-f0d0-47b2-94b3-a37ac4368b0a req-ef8ecf6a-2163-480f-ab47-fba3f932b382 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 945 time: 0.6766968
Jun 01 10:06:50.317655 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 6, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:06:50.317994 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Checking segment: {'id': '718fdfa6-b13d-46f9-85ca-8438bc5d308c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:06:50.318380 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Bound using segment: {'id': '718fdfa6-b13d-46f9-85ca-8438bc5d308c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902'} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:06:50.318832 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Bound port: ba4fa832-87bd-477b-bad8-2837ab09304a, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '718fdfa6-b13d-46f9-85ca-8438bc5d308c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902'}}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:06:50.319209 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:50.366372 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52610dc7-6775-49cf-b35e-56bb416ea245 req-249bd0ef-112b-410c-bde6-978bd4e425f6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:50.368268 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-52610dc7-6775-49cf-b35e-56bb416ea245 req-249bd0ef-112b-410c-bde6-978bd4e425f6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.6764429
Jun 01 10:06:50.458506 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b0b0905c-f0d0-47b2-94b3-a37ac4368b0a req-dfecce07-7b89-44b1-ba11-6dba63b2782e tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1441755
Jun 01 10:06:50.461621 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:50.465180 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:50.505058 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-52610dc7-6775-49cf-b35e-56bb416ea245 req-b3c8e7c3-de7c-403b-baf6-ce675c68b3c5 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1252909
Jun 01 10:06:50.517422 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] For port ba4fa832-87bd-477b-bad8-2837ab09304a, host hv-cinder-78726, cleared binding levels {{(pid=92566) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:06:50.519608 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-e4047c82-b8e6-4c99-8672-ea084f35ea8b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:50.526524 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] For port ba4fa832-87bd-477b-bad8-2837ab09304a, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ba4fa832-87bd-477b-bad8-2837ab09304a,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92566) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:06:50.527516 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:50.542801 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4047c82-b8e6-4c99-8672-ea084f35ea8b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7b9c8026-940a-4d17-9e55-6d8b1ffb3d1d,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:50.555482 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-e4047c82-b8e6-4c99-8672-ea084f35ea8b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:50.556339 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-e4047c82-b8e6-4c99-8672-ea084f35ea8b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:50.562984 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-e4047c82-b8e6-4c99-8672-ea084f35ea8b admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/7b9c8026-940a-4d17-9e55-6d8b1ffb3d1d HTTP/1.1" status: 204  len: 168 time: 1.0039556
Jun 01 10:06:50.592674 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=18b5c352-ee0c-425b-a1bf-666d362844b9,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:50.604290 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:50.619158 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:50.626252 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:50.632938 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:06:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-64f8d48e-5cff-457e-8af6-e47536911dc9 x-openstack-request-id: req-64f8d48e-5cff-457e-8af6-e47536911dc9 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:06:50.633499 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "28696956-78ff-4e48-8a25-b702828c16d5", "name": "network-vif-plugged", "status": "completed", "tag": "18b5c352-ee0c-425b-a1bf-666d362844b9", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:06:50.633900 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-64f8d48e-5cff-457e-8af6-e47536911dc9 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:06:50.635367 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '28696956-78ff-4e48-8a25-b702828c16d5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '18b5c352-ee0c-425b-a1bf-666d362844b9', 'code': 200}
Jun 01 10:06:50.735366 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:50.736183 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:50.737799 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34f953ae-828b-43db-912d-0edf89356e65 req-f1960752-eebb-49be-a422-303a95820699 service neutron] 10.222.0.30 "PUT /v2.0/ports/ba4fa832-87bd-477b-bad8-2837ab09304a HTTP/1.1" status: 200  len: 1094 time: 2.0590420
Jun 01 10:06:50.738791 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '77032f84-7f38-4e7e-b0fd-accc20754797', 'tag': 'ba4fa832-87bd-477b-bad8-2837ab09304a'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:06:50.741396 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b24c129e-2013-4414-a136-b9f6f74dcfeb" -d '{"events": [{"name": "network-changed", "server_uuid": "77032f84-7f38-4e7e-b0fd-accc20754797", "tag": "ba4fa832-87bd-477b-bad8-2837ab09304a"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:06:50.807640 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1960752-eebb-49be-a422-303a95820699 service neutron] Pushing event updated for resources: {'Port': ['ID=ba4fa832-87bd-477b-bad8-2837ab09304a,revision_number=3']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:50.819621 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f1960752-eebb-49be-a422-303a95820699 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:50.872555 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39042771-8709-4a60-af46-e3c38e886ed7 req-2564ef74-3d4d-41af-a92e-9d69409bae77 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:50.874136 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-39042771-8709-4a60-af46-e3c38e886ed7 req-2564ef74-3d4d-41af-a92e-9d69409bae77 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 943 time: 0.1061108
Jun 01 10:06:50.976160 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-39042771-8709-4a60-af46-e3c38e886ed7 req-b65e4c7b-43e4-4450-93e4-224cb290700d tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0963297
Jun 01 10:06:51.010122 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34f953ae-828b-43db-912d-0edf89356e65 req-2c1ab1c0-6a00-40c8-9823-d89e02b7dfb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:51.011677 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34f953ae-828b-43db-912d-0edf89356e65 req-2c1ab1c0-6a00-40c8-9823-d89e02b7dfb6 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=f4f6f875519045a39c1fdbadd53ce517&device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 1097 time: 0.0966434
Jun 01 10:06:51.121949 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34f953ae-828b-43db-912d-0edf89356e65 req-37eb23db-5ebd-4e60-ba31-323711f70e28 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ba4fa832-87bd-477b-bad8-2837ab09304a HTTP/1.1" status: 200  len: 217 time: 0.1011207
Jun 01 10:06:51.123926 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:06:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1b7a544e-7728-499d-8748-dffc4a4372cb x-openstack-request-id: req-1b7a544e-7728-499d-8748-dffc4a4372cb {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:06:51.124326 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "77032f84-7f38-4e7e-b0fd-accc20754797", "tag": "ba4fa832-87bd-477b-bad8-2837ab09304a", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:06:51.124663 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-1b7a544e-7728-499d-8748-dffc4a4372cb {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:06:51.125137 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '77032f84-7f38-4e7e-b0fd-accc20754797', 'tag': 'ba4fa832-87bd-477b-bad8-2837ab09304a', 'status': 'completed', 'code': 200}
Jun 01 10:06:51.190240 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ed9bd0-7823-43ce-a72b-f435a711a5a3 req-95e08495-20f1-4549-8c05-40f8c80198d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:51.191780 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a5ed9bd0-7823-43ce-a72b-f435a711a5a3 req-95e08495-20f1-4549-8c05-40f8c80198d0 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 1098 time: 0.1547532
Jun 01 10:06:51.198015 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34f953ae-828b-43db-912d-0edf89356e65 req-35b464f4-5831-4e69-bc89-f5f982d0749c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:51.199517 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34f953ae-828b-43db-912d-0edf89356e65 req-35b464f4-5831-4e69-bc89-f5f982d0749c service neutron] 10.222.0.30 "GET /v2.0/subnets?id=f2fdda64-a03c-41d7-8178-daca0363bd6e HTTP/1.1" status: 200  len: 855 time: 0.0705159
Jun 01 10:06:51.236371 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a5ed9bd0-7823-43ce-a72b-f435a711a5a3 req-7b70f09e-fc00-4b7b-b7db-6b0603ffe741 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0370884
Jun 01 10:06:51.280525 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34f953ae-828b-43db-912d-0edf89356e65 req-367fb528-d9fc-4816-b862-86dff85e4ea5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:51.282244 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34f953ae-828b-43db-912d-0edf89356e65 req-367fb528-d9fc-4816-b862-86dff85e4ea5 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=be546533-cf92-483d-9e38-7d14ca9c4902&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0757933
Jun 01 10:06:51.434295 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34f953ae-828b-43db-912d-0edf89356e65 req-8f97c94a-6c24-4769-9f2a-e31f9d924f7b service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1410472
Jun 01 10:06:51.575100 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 58246) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:51.604501 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-909a7ba3-5ccd-4036-8ef4-a15a56604cda admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:51.629034 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:06:51.663845 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-909a7ba3-5ccd-4036-8ef4-a15a56604cda admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:51.687665 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-909a7ba3-5ccd-4036-8ef4-a15a56604cda admin admin] Usage tracker for resource:security_group_rule and tenant:a9a8e1f56aaf49b7a886ecadc23e29bf is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:51.689126 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34f953ae-828b-43db-912d-0edf89356e65 req-466770fc-4482-423b-b127-693be25a1f63 service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2464991
Jun 01 10:06:51.698837 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-909a7ba3-5ccd-4036-8ef4-a15a56604cda admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:51.735225 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-909a7ba3-5ccd-4036-8ef4-a15a56604cda admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:51.943454 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c4b8d4ae-e9e9-4d40-a923-e03752a7ad32,segment=NetworkSegment(2f350557-5423-4a12-a64b-0bf55f2578e6),segment_id=2f350557-5423-4a12-a64b-0bf55f2578e6)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:51.973138 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-909a7ba3-5ccd-4036-8ef4-a15a56604cda admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:51.976495 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': 'c4b8d4ae-e9e9-4d40-a923-e03752a7ad32', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'port_id': 'c4b8d4ae-e9e9-4d40-a923-e03752a7ad32', 'mac_address': 'fa:16:3e:1e:fc:57', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 860, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:06:51.984498 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device ea668f76-dcbd-410c-a737-019b6396ac7f up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:52.065886 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a989cf8-3502-4e05-8126-05f3fe987ba9 req-8437f4b0-5017-4f51-ba83-73740b106618 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:52.074585 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8a989cf8-3502-4e05-8126-05f3fe987ba9 req-8437f4b0-5017-4f51-ba83-73740b106618 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 945 time: 0.4720058
Jun 01 10:06:52.075908 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-909a7ba3-5ccd-4036-8ef4-a15a56604cda admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:52.079363 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:52.085302 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-ee6a73e5-1d7e-43ce-a8f2-136ae92947f8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:52.106214 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:06:52.131327 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c4b8d4ae-e9e9-4d40-a923-e03752a7ad32,segment=NetworkSegment(2f350557-5423-4a12-a64b-0bf55f2578e6),segment_id=2f350557-5423-4a12-a64b-0bf55f2578e6)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:52.190443 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:52.192804 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:52.209612 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-909a7ba3-5ccd-4036-8ef4-a15a56604cda admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=a9a8e1f56aaf49b7a886ecadc23e29bf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6325371
Jun 01 10:06:52.212279 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-909a7ba3-5ccd-4036-8ef4-a15a56604cda admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1ae805be-56bc-45e1-be84-4dff2d92c2e5,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:52.215969 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 58268) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:52.232893 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-909a7ba3-5ccd-4036-8ef4-a15a56604cda admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:52.293065 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0cdd6c37-3d2e-4557-ac96-8d7a2beda926 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:52.309932 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=c4b8d4ae-e9e9-4d40-a923-e03752a7ad32,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:52.312887 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port ea668f76-dcbd-410c-a737-019b6396ac7f completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:52.317963 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:52.319522 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port ea668f76-dcbd-410c-a737-019b6396ac7f triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:52.320102 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:52.326759 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0cdd6c37-3d2e-4557-ac96-8d7a2beda926 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:52.334138 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d5f8f50-b8e1-408e-8ff4-d422c4824418 req-a7383323-5e30-4ae9-9b88-b0e71e88d2c8 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:52.335705 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7d5f8f50-b8e1-408e-8ff4-d422c4824418 req-a7383323-5e30-4ae9-9b88-b0e71e88d2c8 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.5742886
Jun 01 10:06:52.388848 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8a989cf8-3502-4e05-8126-05f3fe987ba9 req-59be50da-86de-47c5-8c49-25c59d1232ae tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2995729
Jun 01 10:06:52.398932 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b24c129e-2013-4414-a136-b9f6f74dcfeb req-c5a79bcd-e559-4dac-9236-45a862ce4e5c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:52.400634 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b24c129e-2013-4414-a136-b9f6f74dcfeb req-c5a79bcd-e559-4dac-9236-45a862ce4e5c service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=f4f6f875519045a39c1fdbadd53ce517&device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 1097 time: 0.5218301
Jun 01 10:06:52.476046 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:52.511101 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port ea668f76-dcbd-410c-a737-019b6396ac7f, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ea668f76-dcbd-410c-a737-019b6396ac7f,segment=NetworkSegment(3982460c-82d6-48e1-a5bd-5d7cbbe910af),segment_id=3982460c-82d6-48e1-a5bd-5d7cbbe910af)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:52.525023 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['c4b8d4ae-e9e9-4d40-a923-e03752a7ad32'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:06:52.548477 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7d5f8f50-b8e1-408e-8ff4-d422c4824418 req-3fed49ef-4d6b-4215-b6ee-f77f96b6da73 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2048800
Jun 01 10:06:52.558415 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0cdd6c37-3d2e-4557-ac96-8d7a2beda926 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:52.596648 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b34bcb89-a4b7-4486-b6b0-8cf32912b843 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:52.623816 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cdd6c37-3d2e-4557-ac96-8d7a2beda926 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1ae805be-56bc-45e1-be84-4dff2d92c2e5,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:52.636284 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-0cdd6c37-3d2e-4557-ac96-8d7a2beda926 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:52.647806 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0cdd6c37-3d2e-4557-ac96-8d7a2beda926 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:52.647997 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:52.651849 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-0cdd6c37-3d2e-4557-ac96-8d7a2beda926 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/1ae805be-56bc-45e1-be84-4dff2d92c2e5 HTTP/1.1" status: 204  len: 168 time: 0.4348156
Jun 01 10:06:52.652566 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c12e6393-ac9a-4707-a81b-f2c2c369c53a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ea668f76-dcbd-410c-a737-019b6396ac7f'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:06:52.655316 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ac713a6-a355-437d-b494-71c90898f674" -d '{"events": [{"server_uuid": "c12e6393-ac9a-4707-a81b-f2c2c369c53a", "name": "network-vif-plugged", "status": "completed", "tag": "ea668f76-dcbd-410c-a737-019b6396ac7f"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:06:52.659650 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:52.713996 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b24c129e-2013-4414-a136-b9f6f74dcfeb req-63a397d3-42f9-430a-8633-49f3d48ec2e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:52.715558 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b24c129e-2013-4414-a136-b9f6f74dcfeb req-63a397d3-42f9-430a-8633-49f3d48ec2e5 service neutron] 10.222.0.30 "GET /v2.0/networks?id=be546533-cf92-483d-9e38-7d14ca9c4902 HTTP/1.1" status: 200  len: 917 time: 0.3016670
Jun 01 10:06:52.729247 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c48216-6d4c-4a66-92fe-6fc9169221a2 req-61581182-65e2-4f0e-90b2-2dc70526deea tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:52.730961 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-48c48216-6d4c-4a66-92fe-6fc9169221a2 req-61581182-65e2-4f0e-90b2-2dc70526deea tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 944 time: 0.1928234
Jun 01 10:06:52.783427 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:06:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b59955c7-7712-48ad-b929-039461db5e34 x-openstack-request-id: req-b59955c7-7712-48ad-b929-039461db5e34 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:06:52.787025 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c12e6393-ac9a-4707-a81b-f2c2c369c53a", "name": "network-vif-plugged", "status": "completed", "tag": "ea668f76-dcbd-410c-a737-019b6396ac7f", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:06:52.787025 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-b59955c7-7712-48ad-b929-039461db5e34 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:06:52.787025 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c12e6393-ac9a-4707-a81b-f2c2c369c53a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ea668f76-dcbd-410c-a737-019b6396ac7f', 'code': 200}
Jun 01 10:06:52.838059 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=ea668f76-dcbd-410c-a737-019b6396ac7f,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:52.842430 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:52.854247 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b24c129e-2013-4414-a136-b9f6f74dcfeb req-8082808d-f5de-4fa2-92cb-276eef3a5b8f service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ba4fa832-87bd-477b-bad8-2837ab09304a HTTP/1.1" status: 200  len: 217 time: 0.1222112
Jun 01 10:06:52.915797 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-48c48216-6d4c-4a66-92fe-6fc9169221a2 req-ac8ea933-098e-4631-9fbe-e4c61678509f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1068585
Jun 01 10:06:52.935337 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b24c129e-2013-4414-a136-b9f6f74dcfeb req-c40c6a2a-85e7-4bbe-813c-518e96f69eed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:52.936766 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b24c129e-2013-4414-a136-b9f6f74dcfeb req-c40c6a2a-85e7-4bbe-813c-518e96f69eed service neutron] 10.222.0.30 "GET /v2.0/subnets?id=f2fdda64-a03c-41d7-8178-daca0363bd6e HTTP/1.1" status: 200  len: 855 time: 0.0701935
Jun 01 10:06:53.021724 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b24c129e-2013-4414-a136-b9f6f74dcfeb req-c76542c6-b21d-4d5b-b919-2d8876285943 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:53.023400 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b24c129e-2013-4414-a136-b9f6f74dcfeb req-c76542c6-b21d-4d5b-b919-2d8876285943 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=be546533-cf92-483d-9e38-7d14ca9c4902&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0777678
Jun 01 10:06:53.176100 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b24c129e-2013-4414-a136-b9f6f74dcfeb req-e7fcdab4-ad7b-4849-9b66-54bdbf21772a service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1444046
Jun 01 10:06:53.259191 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cbab3ae-4363-4eed-b0e8-d8ebc644b3cb req-6ff069d2-eb2f-4cc9-bcff-d620785a9116 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:53.260729 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-0cbab3ae-4363-4eed-b0e8-d8ebc644b3cb req-6ff069d2-eb2f-4cc9-bcff-d620785a9116 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 1099 time: 0.0986471
Jun 01 10:06:53.331326 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b24c129e-2013-4414-a136-b9f6f74dcfeb req-1f3822e7-2e99-4bc1-9481-9cfbf69d9f86 service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1477878
Jun 01 10:06:53.469875 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:06:53.589037 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4054f0-24d0-42b7-9776-7dab77c8805e req-cd249e1a-71be-4aa6-be47-53d62d004f33 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:53.590540 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cc4054f0-24d0-42b7-9776-7dab77c8805e req-cd249e1a-71be-4aa6-be47-53d62d004f33 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.0840802
Jun 01 10:06:53.680395 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cc4054f0-24d0-42b7-9776-7dab77c8805e req-f6502889-1be7-45bf-affb-48e0ba27b91e tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0841463
Jun 01 10:06:53.813439 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65465218-e4bc-419c-a3fc-43b4cd46f140 req-858fc78b-70bf-43bc-955b-bad424623843 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:53.814892 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-65465218-e4bc-419c-a3fc-43b4cd46f140 req-858fc78b-70bf-43bc-955b-bad424623843 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.0954313
Jun 01 10:06:53.858971 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-65465218-e4bc-419c-a3fc-43b4cd46f140 req-f8a7093f-fb8f-4c6b-a6f6-295a8c376b5a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0383029
Jun 01 10:06:54.112189 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-517e49a1-8a5a-40d9-9bb6-8f7fd9fa598c req-56575057-d28f-47d4-981d-0209d158c219 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:54.113835 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-517e49a1-8a5a-40d9-9bb6-8f7fd9fa598c req-56575057-d28f-47d4-981d-0209d158c219 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 944 time: 0.0816371
Jun 01 10:06:54.162064 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-517e49a1-8a5a-40d9-9bb6-8f7fd9fa598c req-62594780-4208-4dee-b430-0943d7823c10 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0419433
Jun 01 10:06:54.875006 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b157f941-a842-45fb-91e0-d15c5a937ffa req-2cce8aa6-e4d3-4329-9a4d-01388e9ecf2c tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:54.876455 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b157f941-a842-45fb-91e0-d15c5a937ffa req-2cce8aa6-e4d3-4329-9a4d-01388e9ecf2c tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.0846591
Jun 01 10:06:54.928745 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b157f941-a842-45fb-91e0-d15c5a937ffa req-6bdb4e5b-4d8e-4c32-90af-aa765e2f1bd9 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0459216
Jun 01 10:06:55.070650 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55f94df6-7407-41a9-8013-e70095c0bc99 req-5e49ff34-cf37-4d9a-8228-e0b52c824350 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:55.072235 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-55f94df6-7407-41a9-8013-e70095c0bc99 req-5e49ff34-cf37-4d9a-8228-e0b52c824350 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.0874627
Jun 01 10:06:55.117327 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-55f94df6-7407-41a9-8013-e70095c0bc99 req-a5f310cc-8baf-4f6e-a95c-5861b2dc0b6e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0392087
Jun 01 10:06:55.354333 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-838ae618-8ce1-4d91-9285-ad0ecf6e4841 req-e1dd0522-a8a6-4ffc-aeb4-71d4b4ac5ee2 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:55.355830 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-838ae618-8ce1-4d91-9285-ad0ecf6e4841 req-e1dd0522-a8a6-4ffc-aeb4-71d4b4ac5ee2 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 944 time: 0.0808537
Jun 01 10:06:55.403444 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-838ae618-8ce1-4d91-9285-ad0ecf6e4841 req-c7cc163d-9082-4158-aa97-84625a19290a tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0418525
Jun 01 10:06:56.118509 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a687e594-a406-4098-a655-1e0ddcb1a39a req-4eb3cd3f-9c5f-4881-ae93-8be731d6a8fe tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:56.120030 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a687e594-a406-4098-a655-1e0ddcb1a39a req-4eb3cd3f-9c5f-4881-ae93-8be731d6a8fe tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.0846610
Jun 01 10:06:56.166530 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a687e594-a406-4098-a655-1e0ddcb1a39a req-e8a0df3a-9365-40b4-a14d-1fab90821e6e tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408006
Jun 01 10:06:56.173178 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:56.288362 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-0cbab3ae-4363-4eed-b0e8-d8ebc644b3cb req-7791a5be-ac3f-4dd3-a469-eed085077312 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0372133
Jun 01 10:06:56.312317 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd6c4efc-affc-4e76-a899-d70b0512695e req-4507ae08-b32e-44a6-a4e2-3de8b86946db tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:56.313783 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dd6c4efc-affc-4e76-a899-d70b0512695e req-4507ae08-b32e-44a6-a4e2-3de8b86946db tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.0836029
Jun 01 10:06:56.360868 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dd6c4efc-affc-4e76-a899-d70b0512695e req-32e3b34e-c131-49af-8453-34611f679455 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0408106
Jun 01 10:06:56.596657 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca00a80c-f28a-47b1-a0ab-aa5a35a5fcda req-ec4a26e9-5af8-4c12-924c-7c363b215bf0 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:56.598219 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ca00a80c-f28a-47b1-a0ab-aa5a35a5fcda req-ec4a26e9-5af8-4c12-924c-7c363b215bf0 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 944 time: 0.0869346
Jun 01 10:06:56.644201 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ca00a80c-f28a-47b1-a0ab-aa5a35a5fcda req-7f8fc219-8098-4ecd-894d-1296bcf0d2aa tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0401106
Jun 01 10:06:57.356340 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6486f9bb-3d37-4a6c-8e4a-175a754aaf10 req-1dbc6827-dcb4-456f-8c12-cdb2c0279221 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:57.357848 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6486f9bb-3d37-4a6c-8e4a-175a754aaf10 req-1dbc6827-dcb4-456f-8c12-cdb2c0279221 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.0854616
Jun 01 10:06:57.489960 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6486f9bb-3d37-4a6c-8e4a-175a754aaf10 req-ac66208c-2696-42fe-992d-b05652fd23fa tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1044490
Jun 01 10:06:57.568876 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78b52712-1247-4636-a90f-ecc9ce9e1244 req-08687c2a-68df-4415-9bd9-212a3ee150f6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:57.570366 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-78b52712-1247-4636-a90f-ecc9ce9e1244 req-08687c2a-68df-4415-9bd9-212a3ee150f6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.0825770
Jun 01 10:06:57.633482 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-78b52712-1247-4636-a90f-ecc9ce9e1244 req-0af164f3-c9c9-4636-a00b-8e1e09e06110 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0414279
Jun 01 10:06:57.656330 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device ba4fa832-87bd-477b-bad8-2837ab09304a details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:06:57.656330 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:06:57.873588 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port ba4fa832-87bd-477b-bad8-2837ab09304a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ba4fa832-87bd-477b-bad8-2837ab09304a,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:57.900950 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': 'ba4fa832-87bd-477b-bad8-2837ab09304a', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'port_id': 'ba4fa832-87bd-477b-bad8-2837ab09304a', 'mac_address': 'fa:16:3e:54:58:da', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 861, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:06:57.943870 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e5949bc-4a9e-48f9-9b6e-ff4d750421b2 req-6991ba3f-e683-437d-aecd-700eb5a26d16 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:57.945342 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6e5949bc-4a9e-48f9-9b6e-ff4d750421b2 req-6991ba3f-e683-437d-aecd-700eb5a26d16 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 944 time: 0.1503329
Jun 01 10:06:57.973504 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:57.991538 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6e5949bc-4a9e-48f9-9b6e-ff4d750421b2 req-e55dda8f-8404-4200-8082-4e4b2bb54648 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404694
Jun 01 10:06:58.000317 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ba4fa832-87bd-477b-bad8-2837ab09304a {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:06:58.019127 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port ba4fa832-87bd-477b-bad8-2837ab09304a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ba4fa832-87bd-477b-bad8-2837ab09304a,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:58.270493 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:58.272654 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:58.307638 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:06:58.330422 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:06:58.330799 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:58.395771 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=ba4fa832-87bd-477b-bad8-2837ab09304a,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:58.399341 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:58.465251 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:58.526700 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c4b8d4ae-e9e9-4d40-a923-e03752a7ad32'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:06:58.526700 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f93b1051-663e-4d83-91dc-3ac9c72bef43" -d '{"events": [{"server_uuid": "0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3", "name": "network-vif-plugged", "status": "completed", "tag": "c4b8d4ae-e9e9-4d40-a923-e03752a7ad32"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:06:58.532496 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c4b8d4ae-e9e9-4d40-a923-e03752a7ad32,segment=NetworkSegment(2f350557-5423-4a12-a64b-0bf55f2578e6),segment_id=2f350557-5423-4a12-a64b-0bf55f2578e6)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:06:58.567881 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['ba4fa832-87bd-477b-bad8-2837ab09304a'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:06:58.598579 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:06:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-96b272fb-3648-43b4-8298-e5b27e8d7bf0 x-openstack-request-id: req-96b272fb-3648-43b4-8298-e5b27e8d7bf0 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:06:58.598893 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3", "name": "network-vif-plugged", "status": "completed", "tag": "c4b8d4ae-e9e9-4d40-a923-e03752a7ad32", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:06:58.599177 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-96b272fb-3648-43b4-8298-e5b27e8d7bf0 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:06:58.599590 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c4b8d4ae-e9e9-4d40-a923-e03752a7ad32', 'code': 200}
Jun 01 10:06:58.626093 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:58.631250 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:58.677741 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e0bbeaf-1443-47c9-896c-0705b842d078 req-161f7fa0-4b45-4719-93de-2bcd08c8acbd tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:58.680302 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2e0bbeaf-1443-47c9-896c-0705b842d078 req-161f7fa0-4b45-4719-93de-2bcd08c8acbd tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.0930901
Jun 01 10:06:58.733727 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=c4b8d4ae-e9e9-4d40-a923-e03752a7ad32,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:58.735977 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2e0bbeaf-1443-47c9-896c-0705b842d078 req-b7b867c8-6207-4433-a106-ad097b3b2ecc tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0501404
Jun 01 10:06:58.745276 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:58.836016 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cdd9eb8-1ed7-4bd8-93c7-ef24f92d0f77 req-46de9db1-399a-4c4a-9650-4287eca6d840 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:58.837516 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8cdd9eb8-1ed7-4bd8-93c7-ef24f92d0f77 req-46de9db1-399a-4c4a-9650-4287eca6d840 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 945 time: 0.0907741
Jun 01 10:06:58.981400 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8cdd9eb8-1ed7-4bd8-93c7-ef24f92d0f77 req-7d71c2f9-b9ae-4d0f-b7e4-716d374bd6f4 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1352615
Jun 01 10:06:59.108468 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad57bc2f-86e3-4e98-b983-43abf0a40e93 req-25f8859c-3bee-435a-a430-039ba800e836 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:59.124687 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-ad57bc2f-86e3-4e98-b983-43abf0a40e93 req-25f8859c-3bee-435a-a430-039ba800e836 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 1098 time: 0.1066542
Jun 01 10:06:59.173750 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-ad57bc2f-86e3-4e98-b983-43abf0a40e93 req-f3024c2f-865d-487f-9a48-d37c17f3015f service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0411589
Jun 01 10:06:59.202671 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2751df9a-0ae9-48f5-9578-f4ffbc15a6af req-acd9e674-fb2b-4cd4-9114-4385092b138e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:59.204184 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2751df9a-0ae9-48f5-9578-f4ffbc15a6af req-acd9e674-fb2b-4cd4-9114-4385092b138e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0885427
Jun 01 10:06:59.254763 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2751df9a-0ae9-48f5-9578-f4ffbc15a6af req-f880d46e-d165-4bf2-b6bb-f5a233ad3f14 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0448794
Jun 01 10:06:59.502174 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-601f405f-5c0b-40b7-9189-a7d1b5b8da43 req-451a996e-55db-4f59-9239-cb6600fecb9f tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:59.505335 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-601f405f-5c0b-40b7-9189-a7d1b5b8da43 req-451a996e-55db-4f59-9239-cb6600fecb9f tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.0925140
Jun 01 10:06:59.513659 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6949f478-4c6a-42cc-8c27-8aac5da9de82 req-25415b6b-5e45-4f7a-811e-f396a71d18cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:59.515205 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-6949f478-4c6a-42cc-8c27-8aac5da9de82 req-25415b6b-5e45-4f7a-811e-f396a71d18cb service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=ef4bc75ba53a44cca2e4b7c2b8aeb818&device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 1099 time: 0.0800810
Jun 01 10:06:59.531997 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 58468) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:59.592226 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-601f405f-5c0b-40b7-9189-a7d1b5b8da43 req-0f94b2c2-c8e1-4c53-baec-a5b156e5da0b tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0789945
Jun 01 10:06:59.662228 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6949f478-4c6a-42cc-8c27-8aac5da9de82 req-804a6bcc-3e21-4303-9f77-614b31d12d22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:59.663670 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-6949f478-4c6a-42cc-8c27-8aac5da9de82 req-804a6bcc-3e21-4303-9f77-614b31d12d22 service neutron] 10.222.0.30 "GET /v2.0/networks?id=34268ce8-8baf-41d5-acbc-1b6c167dd481 HTTP/1.1" status: 200  len: 920 time: 0.1394916
Jun 01 10:06:59.681011 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a28886e0-cb52-4134-bd81-892280494e54 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:59.697726 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-a28886e0-cb52-4134-bd81-892280494e54 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:06:59.701620 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-a28886e0-cb52-4134-bd81-892280494e54 admin admin] Usage tracker for resource:security_group_rule and tenant:d73dd524200b40c8bd4bc33ec4ef0586 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:06:59.704520 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-a28886e0-cb52-4134-bd81-892280494e54 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:06:59.710959 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-a28886e0-cb52-4134-bd81-892280494e54 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:06:59.739260 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-6949f478-4c6a-42cc-8c27-8aac5da9de82 req-8cf17879-d86c-43b7-9437-5eaf2c09b599 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ea668f76-dcbd-410c-a737-019b6396ac7f HTTP/1.1" status: 200  len: 217 time: 0.0670869
Jun 01 10:06:59.799575 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a28886e0-cb52-4134-bd81-892280494e54 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:59.806893 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6949f478-4c6a-42cc-8c27-8aac5da9de82 req-0f6f69dd-9998-46c4-a06f-b1c5f469b645 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:06:59.808339 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-6949f478-4c6a-42cc-8c27-8aac5da9de82 req-0f6f69dd-9998-46c4-a06f-b1c5f469b645 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2ee54c26-f286-4f9a-b791-24aa84feb26a HTTP/1.1" status: 200  len: 859 time: 0.0611172
Jun 01 10:06:59.855680 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-6949f478-4c6a-42cc-8c27-8aac5da9de82 req-e25bb608-9baa-44a2-bdd3-fd3a0f626600 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=34268ce8-8baf-41d5-acbc-1b6c167dd481&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0404532
Jun 01 10:06:59.862419 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a28886e0-cb52-4134-bd81-892280494e54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:59.869885 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-e4047c82-b8e6-4c99-8672-ea084f35ea8b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:06:59.911446 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-a28886e0-cb52-4134-bd81-892280494e54 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=d73dd524200b40c8bd4bc33ec4ef0586&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3768339
Jun 01 10:06:59.912399 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a28886e0-cb52-4134-bd81-892280494e54 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ada051ef-f4f0-4090-a090-7e15c6e8cce0,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:06:59.914716 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 58478) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:06:59.917387 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a28886e0-cb52-4134-bd81-892280494e54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:06:59.980833 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-84c3df7e-bbd0-45c5-a42a-484ef5c3aede admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:06:59.998332 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-6949f478-4c6a-42cc-8c27-8aac5da9de82 req-969f2ea1-8c6b-4a71-86a4-93a9163054af service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1306274
Jun 01 10:07:00.007911 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-84c3df7e-bbd0-45c5-a42a-484ef5c3aede admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:00.140922 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-84c3df7e-bbd0-45c5-a42a-484ef5c3aede admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:00.141736 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-6949f478-4c6a-42cc-8c27-8aac5da9de82 req-312e79d1-69af-4b0b-9ada-258ff4003ee2 service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1345441
Jun 01 10:07:00.146381 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-82bfea5a-3914-4ecb-8fe1-c3f08d465fa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:00.161514 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84c3df7e-bbd0-45c5-a42a-484ef5c3aede admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ada051ef-f4f0-4090-a090-7e15c6e8cce0,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:00.174996 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-84c3df7e-bbd0-45c5-a42a-484ef5c3aede admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:00.185049 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-84c3df7e-bbd0-45c5-a42a-484ef5c3aede admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:00.186172 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-84c3df7e-bbd0-45c5-a42a-484ef5c3aede admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/ada051ef-f4f0-4090-a090-7e15c6e8cce0 HTTP/1.1" status: 204  len: 168 time: 0.2705476
Jun 01 10:07:00.214859 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a00bbc2-7a4a-4309-90f1-dea5af5215e6 req-9b7d363c-7ebe-4682-a0ac-22703b1db19d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:00.216463 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8a00bbc2-7a4a-4309-90f1-dea5af5215e6 req-9b7d363c-7ebe-4682-a0ac-22703b1db19d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 945 time: 0.1209550
Jun 01 10:07:00.304944 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8a00bbc2-7a4a-4309-90f1-dea5af5215e6 req-ad34348f-703a-42d8-b6ec-131aa69de8cb tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0811355
Jun 01 10:07:00.478093 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3256b710-a531-4634-9786-679dd4f75877 req-e590a62e-e72e-4ee6-839c-e660f60dcdfe tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:00.479621 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3256b710-a531-4634-9786-679dd4f75877 req-e590a62e-e72e-4ee6-839c-e660f60dcdfe tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0899136
Jun 01 10:07:00.527791 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3256b710-a531-4634-9786-679dd4f75877 req-9555d096-9579-4216-a317-227f2fac0170 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0411222
Jun 01 10:07:00.798359 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fe387af-d6de-4123-a546-f67d830edfbf req-c6b10dbd-861a-4b42-bfc6-3943b3f68859 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:00.799845 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6fe387af-d6de-4123-a546-f67d830edfbf req-c6b10dbd-861a-4b42-bfc6-3943b3f68859 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.0841041
Jun 01 10:07:00.847792 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6fe387af-d6de-4123-a546-f67d830edfbf req-60219d26-fb6f-449d-b298-3b9273e94676 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414906
Jun 01 10:07:00.999619 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 58514) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:01.016349 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:01.031215 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:01.035081 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Usage tracker for resource:security_group_rule and tenant:0b4063ff0e654448804312e7dffbcd20 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:01.038510 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:01.044264 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:01.139789 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:01.216921 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:01.233114 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:01.270191 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=0b4063ff0e654448804312e7dffbcd20&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2699561
Jun 01 10:07:01.272494 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=249bca10-ef59-4d5b-8eb6-f133870cb110,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:01.273330 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 58530) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:01.280289 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:01.288452 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:01.288452 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:01.288452 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:01.288452 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:01.288452 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:01.288452 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:01.288452 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:01.288452 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:01.288452 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:01.288452 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:01.288452 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:01.288452 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:01.340091 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-e5bc2adc-6f36-4c49-9346-b5d1f1672638 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:01.365538 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-e5bc2adc-6f36-4c49-9346-b5d1f1672638 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:01.530032 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2703a0e6-de9e-453c-88cf-e019e39b8dd7 req-f5bfb4ba-007b-45c6-9b6c-d3967fcbedd0 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:01.531520 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2703a0e6-de9e-453c-88cf-e019e39b8dd7 req-f5bfb4ba-007b-45c6-9b6c-d3967fcbedd0 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 945 time: 0.0903337
Jun 01 10:07:01.552265 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-e5bc2adc-6f36-4c49-9346-b5d1f1672638 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:01.558675 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:01.579486 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5bc2adc-6f36-4c49-9346-b5d1f1672638 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=249bca10-ef59-4d5b-8eb6-f133870cb110,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:01.586273 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-e5bc2adc-6f36-4c49-9346-b5d1f1672638 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:01.599270 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2703a0e6-de9e-453c-88cf-e019e39b8dd7 req-98a93552-2335-4697-88ba-1e399c941db9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0619795
Jun 01 10:07:01.600040 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-e5bc2adc-6f36-4c49-9346-b5d1f1672638 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:01.601134 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-e5bc2adc-6f36-4c49-9346-b5d1f1672638 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/249bca10-ef59-4d5b-8eb6-f133870cb110 HTTP/1.1" status: 204  len: 168 time: 0.3267310
Jun 01 10:07:01.683526 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device ba4fa832-87bd-477b-bad8-2837ab09304a up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:07:01.723852 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80629acd-088f-4832-a57f-0cd0c401a8bb req-69e54e8c-3e85-4552-8be0-89d8db77cd33 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:01.725355 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-80629acd-088f-4832-a57f-0cd0c401a8bb req-69e54e8c-3e85-4552-8be0-89d8db77cd33 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0824435
Jun 01 10:07:01.778981 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-80629acd-088f-4832-a57f-0cd0c401a8bb req-8449f58c-1ca2-451b-8a4a-93ce90763874 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0452278
Jun 01 10:07:01.848766 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 58550) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:01.877044 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port ba4fa832-87bd-477b-bad8-2837ab09304a completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:07:01.892646 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port ba4fa832-87bd-477b-bad8-2837ab09304a triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:07:01.893026 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:02.020357 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:02.048384 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '77032f84-7f38-4e7e-b0fd-accc20754797', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ba4fa832-87bd-477b-bad8-2837ab09304a'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:07:02.050582 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d40ee91c-1c8e-428c-a030-7f1b9ce287d1" -d '{"events": [{"server_uuid": "77032f84-7f38-4e7e-b0fd-accc20754797", "name": "network-vif-plugged", "status": "completed", "tag": "ba4fa832-87bd-477b-bad8-2837ab09304a"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:07:02.058775 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port ba4fa832-87bd-477b-bad8-2837ab09304a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ba4fa832-87bd-477b-bad8-2837ab09304a,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:07:02.063247 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:02.092708 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:02.102215 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Usage tracker for resource:security_group_rule and tenant:e688306864a34c7c882cb7347a26c1a7 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:02.106328 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:02.118302 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:02.139924 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88b21b86-0b72-4990-a91a-c02bd3ada015 req-80c523cc-31fd-4882-acb8-0ae885993e68 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:02.141377 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-88b21b86-0b72-4990-a91a-c02bd3ada015 req-80c523cc-31fd-4882-acb8-0ae885993e68 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.2279735
Jun 01 10:07:02.150558 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 58570) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:02.156771 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:02.159332 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-2ff7b76c-0248-4172-8218-6504f6815aa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Request body: {'floatingip': {'port_id': 'c4b8d4ae-e9e9-4d40-a923-e03752a7ad32'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:07:02.159741 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:02.164057 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc18e1a-4c6e-48be-a53a-9cc99258edb0 req-74df841f-be80-4055-b61e-b156b692fa63 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:02.171375 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6dc18e1a-4c6e-48be-a53a-9cc99258edb0 req-74df841f-be80-4055-b61e-b156b692fa63 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.1868174
Jun 01 10:07:02.213053 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:07:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-61c32b6f-cd9d-438d-a640-cc896f5ddf71 x-openstack-request-id: req-61c32b6f-cd9d-438d-a640-cc896f5ddf71 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:07:02.213349 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "77032f84-7f38-4e7e-b0fd-accc20754797", "name": "network-vif-plugged", "status": "completed", "tag": "ba4fa832-87bd-477b-bad8-2837ab09304a", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:07:02.213614 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-61c32b6f-cd9d-438d-a640-cc896f5ddf71 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:07:02.214003 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '77032f84-7f38-4e7e-b0fd-accc20754797', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ba4fa832-87bd-477b-bad8-2837ab09304a', 'code': 200}
Jun 01 10:07:02.242843 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6dc18e1a-4c6e-48be-a53a-9cc99258edb0 req-6c38266c-9dab-4faf-9bbe-034bd53c23d4 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0703559
Jun 01 10:07:02.273246 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=ba4fa832-87bd-477b-bad8-2837ab09304a,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:02.276978 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:02.321580 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:02.321670 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2ff7b76c-0248-4172-8218-6504f6815aa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for floatingip, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:02.405268 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:02.413007 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-70a17861-ee00-470f-a09f-f0b10dd19532 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:02.455065 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=e688306864a34c7c882cb7347a26c1a7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6048908
Jun 01 10:07:02.456283 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4702bcf4-77d2-48be-9316-cb77423ea74f,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:02.464914 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 58580) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:02.479462 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:02.479830 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:02.480213 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:02.480672 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:02.481027 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:02.481368 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:02.481699 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:02.482037 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:02.482373 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:02.482936 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:02.483051 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:02.483372 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:02.487100 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:02.617580 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-9058b0fd-b994-438d-a82c-8bdba9fa3ddb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:02.648354 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-9058b0fd-b994-438d-a82c-8bdba9fa3ddb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:02.784665 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-9058b0fd-b994-438d-a82c-8bdba9fa3ddb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:02.789839 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-025e9ee3-b84b-4377-bad4-f5c65b2837f2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:02.803895 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9058b0fd-b994-438d-a82c-8bdba9fa3ddb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4702bcf4-77d2-48be-9316-cb77423ea74f,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:02.808281 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-9058b0fd-b994-438d-a82c-8bdba9fa3ddb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:02.811974 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-9058b0fd-b994-438d-a82c-8bdba9fa3ddb admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:02.818190 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-9058b0fd-b994-438d-a82c-8bdba9fa3ddb admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/4702bcf4-77d2-48be-9316-cb77423ea74f HTTP/1.1" status: 204  len: 168 time: 0.3558919
Jun 01 10:07:02.836951 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be02e8c6-0416-482f-a8e7-777c3dc031e8 req-2e580eee-3ba4-4aec-aefc-40a635aff245 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:02.847461 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-be02e8c6-0416-482f-a8e7-777c3dc031e8 req-2e580eee-3ba4-4aec-aefc-40a635aff245 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1237347
Jun 01 10:07:02.899690 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-be02e8c6-0416-482f-a8e7-777c3dc031e8 req-0821b3ae-9a33-48cd-9339-4da19711e551 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0510542
Jun 01 10:07:03.201479 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2ff7b76c-0248-4172-8218-6504f6815aa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:03.276446 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2ff7b76c-0248-4172-8218-6504f6815aa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:03.440774 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e71ef59-3258-4cf4-aa6f-3458f79bd690 req-e7aade9f-a5b1-49c8-b304-b652d7f30784 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:03.444152 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2e71ef59-3258-4cf4-aa6f-3458f79bd690 req-e7aade9f-a5b1-49c8-b304-b652d7f30784 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.0850177
Jun 01 10:07:03.469151 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.l3_db [None req-2ff7b76c-0248-4172-8218-6504f6815aa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Floating IP 556f0a0e-eab7-43f4-9138-6ecc313144fd associated. External IP: 172.27.2.97, port: c4b8d4ae-e9e9-4d40-a923-e03752a7ad32.
Jun 01 10:07:03.507451 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2e71ef59-3258-4cf4-aa6f-3458f79bd690 req-76180c1d-0c43-4d40-9869-dc06615beefd tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0586462
Jun 01 10:07:03.592527 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 58610) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:03.615131 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a99974ca-eb9b-44ea-ac53-a6cfd61039a3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:03.630273 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-a99974ca-eb9b-44ea-ac53-a6cfd61039a3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:03.634176 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-a99974ca-eb9b-44ea-ac53-a6cfd61039a3 admin admin] Usage tracker for resource:security_group_rule and tenant:c329477006d441a88742588d90d12208 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:03.636945 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-a99974ca-eb9b-44ea-ac53-a6cfd61039a3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:03.642543 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-a99974ca-eb9b-44ea-ac53-a6cfd61039a3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:03.765982 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a99974ca-eb9b-44ea-ac53-a6cfd61039a3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:03.851898 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2ff7b76c-0248-4172-8218-6504f6815aa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Router d0653611-f9db-4b67-b4b2-4c0789fb691f has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:07:03.852613 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a99974ca-eb9b-44ea-ac53-a6cfd61039a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:03.861008 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:03.899446 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a99974ca-eb9b-44ea-ac53-a6cfd61039a3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6f0cb245-99f3-4490-bbb0-5c96e4ab8eec,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:03.906337 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-a99974ca-eb9b-44ea-ac53-a6cfd61039a3 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=c329477006d441a88742588d90d12208&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3127303
Jun 01 10:07:03.907031 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 58620) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:03.907811 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a99974ca-eb9b-44ea-ac53-a6cfd61039a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:03.977104 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a40096c8-d226-455f-8831-abc135d696d4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:04.004798 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a40096c8-d226-455f-8831-abc135d696d4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:04.122076 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e68965b-6a0e-4e59-9229-9e1421a0e6c9 req-c6dcd91a-9b2d-4049-8a80-38d8118ca8bf tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:04.124727 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2ff7b76c-0248-4172-8218-6504f6815aa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:07:04.124866 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9e68965b-6a0e-4e59-9229-9e1421a0e6c9 req-c6dcd91a-9b2d-4049-8a80-38d8118ca8bf tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1005991
Jun 01 10:07:04.135536 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2ff7b76c-0248-4172-8218-6504f6815aa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:04.135952 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bed45805-7820-486f-be21-6da791229b73 None None] Sync routers for ids ['d0653611-f9db-4b67-b4b2-4c0789fb691f'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:07:04.145808 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bed45805-7820-486f-be21-6da791229b73 None None] Routers {'d0653611-f9db-4b67-b4b2-4c0789fb691f'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:07:04.146415 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-bed45805-7820-486f-be21-6da791229b73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7277caf0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:06:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d0653611-f9db-4b67-b4b2-4c0789fb691f'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:07:04.183169 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9e68965b-6a0e-4e59-9229-9e1421a0e6c9 req-8db7aedd-7748-4386-b417-bcfad0194713 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0397367
Jun 01 10:07:04.183740 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a40096c8-d226-455f-8831-abc135d696d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:04.187299 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6cfac790-a934-40c5-83a7-c7ee16df58e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:04.198884 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a40096c8-d226-455f-8831-abc135d696d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f0cb245-99f3-4490-bbb0-5c96e4ab8eec,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:04.199704 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-2ff7b76c-0248-4172-8218-6504f6815aa1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "PUT /v2.0/floatingips/556f0a0e-eab7-43f4-9138-6ecc313144fd HTTP/1.1" status: 200  len: 990 time: 2.0477664
Jun 01 10:07:04.200821 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3', 'tag': 'c4b8d4ae-e9e9-4d40-a923-e03752a7ad32'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:07:04.201690 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a40096c8-d226-455f-8831-abc135d696d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:04.203515 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-28c0f99d-9700-4169-9c03-d13343c0d2b2" -d '{"events": [{"name": "network-changed", "server_uuid": "0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3", "tag": "c4b8d4ae-e9e9-4d40-a923-e03752a7ad32"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:07:04.207239 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a40096c8-d226-455f-8831-abc135d696d4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:04.220470 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-a40096c8-d226-455f-8831-abc135d696d4 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/6f0cb245-99f3-4490-bbb0-5c96e4ab8eec HTTP/1.1" status: 204  len: 168 time: 0.3013043
Jun 01 10:07:04.269596 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:07:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8f1132de-81e0-4f57-8e75-5aa460b399ba x-openstack-request-id: req-8f1132de-81e0-4f57-8e75-5aa460b399ba {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:07:04.269902 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3", "tag": "c4b8d4ae-e9e9-4d40-a923-e03752a7ad32", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:07:04.271048 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-8f1132de-81e0-4f57-8e75-5aa460b399ba {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:07:04.271460 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3', 'tag': 'c4b8d4ae-e9e9-4d40-a923-e03752a7ad32', 'status': 'completed', 'code': 200}
Jun 01 10:07:04.336115 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-bed45805-7820-486f-be21-6da791229b73 None None] Set router d0653611-f9db-4b67-b4b2-4c0789fb691f gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:07:04.702454 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1e62533-8941-4a50-84e1-e5c29898f737 req-dff967d8-3b22-4065-b352-db1e77278abe tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:04.703930 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e1e62533-8941-4a50-84e1-e5c29898f737 req-dff967d8-3b22-4065-b352-db1e77278abe tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.0842023
Jun 01 10:07:04.741527 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-bed45805-7820-486f-be21-6da791229b73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7277caf0>, [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:10Z', 'revision_number': 4, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '556f0a0e-eab7-43f4-9138-6ecc313144fd', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'floating_ip_address': '172.27.2.97', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'port_id': 'c4b8d4ae-e9e9-4d40-a923-e03752a7ad32', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 116, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'mac_address': 'fa:16:3e:1e:fc:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:06:24Z', 'updated_at': '2021-06-01T10:07:03Z', 'revision_number': 1, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71', 'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'mac_address': 'fa:16:3e:a9:83:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:23Z', 'revision_number': 5, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'subnets': [{'id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:07:04.747007 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bed45805-7820-486f-be21-6da791229b73 None None] Checking router: d0653611-f9db-4b67-b4b2-4c0789fb691f for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:07:04.756657 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e1e62533-8941-4a50-84e1-e5c29898f737 req-27ff7fb2-519f-4530-a025-a95c9d613ca6 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0466819
Jun 01 10:07:04.758977 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bed45805-7820-486f-be21-6da791229b73 None None] Routers {'d0653611-f9db-4b67-b4b2-4c0789fb691f'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:07:04.759894 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-bed45805-7820-486f-be21-6da791229b73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7277caf0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:06:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d0653611-f9db-4b67-b4b2-4c0789fb691f'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:07:04.938010 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-bed45805-7820-486f-be21-6da791229b73 None None] Set router d0653611-f9db-4b67-b4b2-4c0789fb691f gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:07:04.988602 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 58644) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:05.005311 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4604f5e9-f66c-4d35-89c4-7aa4dd5bc8ba admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:05.020526 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-4604f5e9-f66c-4d35-89c4-7aa4dd5bc8ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:05.024383 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-4604f5e9-f66c-4d35-89c4-7aa4dd5bc8ba admin admin] Usage tracker for resource:security_group_rule and tenant:d6e53faad87b43d097824edbd5bec8a0 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:05.027274 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-4604f5e9-f66c-4d35-89c4-7aa4dd5bc8ba admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:05.033543 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-4604f5e9-f66c-4d35-89c4-7aa4dd5bc8ba admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:05.125598 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4604f5e9-f66c-4d35-89c4-7aa4dd5bc8ba admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:05.126523 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28c0f99d-9700-4169-9c03-d13343c0d2b2 req-1d04e940-f563-41bb-99f1-eaa52372f3c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:05.128032 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-28c0f99d-9700-4169-9c03-d13343c0d2b2 req-1d04e940-f563-41bb-99f1-eaa52372f3c8 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=d13dc1de700d428a8982ca87f11948d0&device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 1098 time: 0.0900807
Jun 01 10:07:05.230533 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4604f5e9-f66c-4d35-89c4-7aa4dd5bc8ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:05.246625 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-894a1d55-1425-4565-9394-a08c75447143 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:05.285277 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4604f5e9-f66c-4d35-89c4-7aa4dd5bc8ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2820e453-9d9e-4fbb-a98b-5f5d8c5e124f,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:05.287868 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28c0f99d-9700-4169-9c03-d13343c0d2b2 req-8d337af4-7a36-4b8e-8f99-0a032d0c4ffd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:05.290356 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-28c0f99d-9700-4169-9c03-d13343c0d2b2 req-8d337af4-7a36-4b8e-8f99-0a032d0c4ffd service neutron] 10.222.0.30 "GET /v2.0/networks?id=3d9ff4d3-b145-4108-a593-976a9cfb63dc HTTP/1.1" status: 200  len: 911 time: 0.1544249
Jun 01 10:07:05.304247 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-4604f5e9-f66c-4d35-89c4-7aa4dd5bc8ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:05.321899 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-bed45805-7820-486f-be21-6da791229b73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7277caf0>, [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:10Z', 'revision_number': 4, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '556f0a0e-eab7-43f4-9138-6ecc313144fd', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'floating_ip_address': '172.27.2.97', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'port_id': 'c4b8d4ae-e9e9-4d40-a923-e03752a7ad32', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 116, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'mac_address': 'fa:16:3e:1e:fc:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:06:24Z', 'updated_at': '2021-06-01T10:07:03Z', 'revision_number': 1, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71', 'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'mac_address': 'fa:16:3e:a9:83:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:23Z', 'revision_number': 5, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'subnets': [{'id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:07:05.326143 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bed45805-7820-486f-be21-6da791229b73 None None] The sync data for ids ['d0653611-f9db-4b67-b4b2-4c0789fb691f'] in dv-cinder-787262-4-iscsi is: [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:10Z', 'revision_number': 4, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '556f0a0e-eab7-43f4-9138-6ecc313144fd', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'floating_ip_address': '172.27.2.97', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'port_id': 'c4b8d4ae-e9e9-4d40-a923-e03752a7ad32', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 116, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'mac_address': 'fa:16:3e:1e:fc:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:06:24Z', 'updated_at': '2021-06-01T10:07:03Z', 'revision_number': 1, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71', 'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'mac_address': 'fa:16:3e:a9:83:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:23Z', 'revision_number': 5, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'subnets': [{'id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:07:05.367094 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-4604f5e9-f66c-4d35-89c4-7aa4dd5bc8ba admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=d6e53faad87b43d097824edbd5bec8a0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3820751
Jun 01 10:07:05.375636 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 58650) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:05.434792 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-28c0f99d-9700-4169-9c03-d13343c0d2b2 req-879fad14-45cf-4568-8e19-e91998621ee9 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 HTTP/1.1" status: 200  len: 998 time: 0.1334403
Jun 01 10:07:05.594818 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a1f8c834-21ec-47cd-8e0d-a093cf70a90f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:05.594945 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28c0f99d-9700-4169-9c03-d13343c0d2b2 req-305e8c0b-537d-47aa-8eae-65413fa12699 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:05.594945 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-28c0f99d-9700-4169-9c03-d13343c0d2b2 req-305e8c0b-537d-47aa-8eae-65413fa12699 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2a00a573-a4bb-4d2d-a3e6-7aef03966618 HTTP/1.1" status: 200  len: 849 time: 0.0629280
Jun 01 10:07:05.595126 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d90195e-1817-4e48-9073-a6b31ad94c0c req-0a95ddff-4aa8-4e62-b028-6a04a9afc8a0 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:05.595126 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2d90195e-1817-4e48-9073-a6b31ad94c0c req-0a95ddff-4aa8-4e62-b028-6a04a9afc8a0 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.2063093
Jun 01 10:07:05.595126 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a1f8c834-21ec-47cd-8e0d-a093cf70a90f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:05.595369 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28c0f99d-9700-4169-9c03-d13343c0d2b2 req-892b6b87-72a4-4eda-bc45-de50e395022e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:05.595369 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-28c0f99d-9700-4169-9c03-d13343c0d2b2 req-892b6b87-72a4-4eda-bc45-de50e395022e service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=3d9ff4d3-b145-4108-a593-976a9cfb63dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0728528
Jun 01 10:07:05.644272 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2d90195e-1817-4e48-9073-a6b31ad94c0c req-c6da3ec6-bde9-4942-adcd-04659ab0c67d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1028495
Jun 01 10:07:05.653631 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce4eb26c-b1aa-4d75-9e39-b1ff5d8261f5 req-cba0a859-b609-43b7-ab3b-4da337b0495e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:05.657368 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ce4eb26c-b1aa-4d75-9e39-b1ff5d8261f5 req-cba0a859-b609-43b7-ab3b-4da337b0495e service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 1099 time: 0.1991231
Jun 01 10:07:05.720751 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-ce4eb26c-b1aa-4d75-9e39-b1ff5d8261f5 req-90d35f19-91cc-4711-a3c4-8b28fe107c18 service neutron] Synchronizing usage tracker for tenant:fa2a1f8cdcd643dfbe904612d65dc770 on resource:security_group {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:07:05.753181 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-004fdcc5-6782-477a-b06f-4c6a542f50e6 None None] New status for floating IP 556f0a0e-eab7-43f4-9138-6ecc313144fd: ACTIVE {{(pid=92567) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:07:05.763805 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-28c0f99d-9700-4169-9c03-d13343c0d2b2 req-c5fb7585-18c8-4b4d-b868-34bc7aee8862 service neutron] 10.222.0.30 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1597185
Jun 01 10:07:05.780698 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a1f8c834-21ec-47cd-8e0d-a093cf70a90f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:05.784957 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-23232c91-f303-47d3-9e5d-1e0a98f4ef21 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:05.796912 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1f8c834-21ec-47cd-8e0d-a093cf70a90f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2820e453-9d9e-4fbb-a98b-5f5d8c5e124f,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:05.800646 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a1f8c834-21ec-47cd-8e0d-a093cf70a90f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:05.807564 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a1f8c834-21ec-47cd-8e0d-a093cf70a90f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:05.811098 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-a1f8c834-21ec-47cd-8e0d-a093cf70a90f admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/2820e453-9d9e-4fbb-a98b-5f5d8c5e124f HTTP/1.1" status: 204  len: 168 time: 0.4326427
Jun 01 10:07:05.841400 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-ce4eb26c-b1aa-4d75-9e39-b1ff5d8261f5 req-90d35f19-91cc-4711-a3c4-8b28fe107c18 service neutron] Unset dirty status for tenant:fa2a1f8cdcd643dfbe904612d65dc770 on resource:security_group {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:07:05.842759 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ce4eb26c-b1aa-4d75-9e39-b1ff5d8261f5 req-90d35f19-91cc-4711-a3c4-8b28fe107c18 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1695163
Jun 01 10:07:05.951628 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-28c0f99d-9700-4169-9c03-d13343c0d2b2 req-1d9e1a3a-9f1b-4973-a3ec-029ebe6122f7 service neutron] 10.222.0.30 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1801729
Jun 01 10:07:06.072201 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3173ddcf-39df-4433-972f-45c6a152c93d req-2209b97b-076f-4100-ae4b-a58161ab1eca tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:06.073717 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3173ddcf-39df-4433-972f-45c6a152c93d req-2209b97b-076f-4100-ae4b-a58161ab1eca tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.1205580
Jun 01 10:07:06.127821 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3173ddcf-39df-4433-972f-45c6a152c93d req-33351b65-d450-4630-b098-402f3e7f7634 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0479667
Jun 01 10:07:06.879283 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c668659-81e6-42a5-a000-ef2c64d30672 req-a094f592-f4d3-4f66-8fcc-f7895648880c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:06.881424 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9c668659-81e6-42a5-a000-ef2c64d30672 req-a094f592-f4d3-4f66-8fcc-f7895648880c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.0974200
Jun 01 10:07:06.966779 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9c668659-81e6-42a5-a000-ef2c64d30672 req-2d77c436-5238-4e69-830d-c2623bdc9060 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0745425
Jun 01 10:07:07.188189 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 58726) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:07.371287 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38c1152e-23a0-4141-9dd1-00cc9eb22854 req-bee9cdd8-77f1-463b-a41f-1e7571dcb22d tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:07.373054 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-38c1152e-23a0-4141-9dd1-00cc9eb22854 req-bee9cdd8-77f1-463b-a41f-1e7571dcb22d tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.1105745
Jun 01 10:07:07.395843 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-2096590688-network', 'tenant_id': '4dfe4071c865475da8fdf2fb00d78d1a'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:07:07.400108 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:07.411552 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Usage tracker for resource:network and tenant:4dfe4071c865475da8fdf2fb00d78d1a is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:07.419761 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:07.435361 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:07.454479 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-38c1152e-23a0-4141-9dd1-00cc9eb22854 req-d77c9f96-ee46-425d-a3ac-1375e19a7f78 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0709546
Jun 01 10:07:07.572902 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Made reservation on behalf of 4dfe4071c865475da8fdf2fb00d78d1a for: {'network': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:07:07.578074 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:07.589651 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:07.605416 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:07.609227 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Usage tracker for resource:security_group_rule and tenant:4dfe4071c865475da8fdf2fb00d78d1a is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:07.612068 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:07.621899 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:07.708839 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:07.879842 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:07.885043 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-3d7b0a7f-9751-491c-a8ae-b1739b6cb50d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:07.912854 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 890}  {{(pid=92565) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:07:07.925473 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=684cd0af-0564-4ce2-807a-5fd1f5b4bbdd,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:07.930038 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:07.930994 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:07.931331 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.segments_db [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Added segment 718f4e32-457c-4c85-a7dd-a74950675598 of type vlan for network 07fdf8d3-44fa-4947-b167-16794fbf5df9
Jun 01 10:07:07.958712 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:08.087037 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:08.088312 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:08.088933 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:08.092496 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-389d2ffa-433e-4863-a75e-3dab38912d73 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:08.196909 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Pushing event updated for resources: {'Network': ['ID=07fdf8d3-44fa-4947-b167-16794fbf5df9,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:08.199737 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:08.210242 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network 07fdf8d3-44fa-4947-b167-16794fbf5df9 details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:07:08.226794 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57dabf71-055d-48f8-915e-7b1645fe4356 req-a3463e56-85b9-4c92-a089-ed78b41347f6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:08.228654 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-57dabf71-055d-48f8-915e-7b1645fe4356 req-a3463e56-85b9-4c92-a089-ed78b41347f6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1479483
Jun 01 10:07:08.280574 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51441f34-99d7-4352-844f-3a9b2bc70811 req-26426a72-ee43-49fe-b729-3f40b4182f5a tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:08.282024 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-51441f34-99d7-4352-844f-3a9b2bc70811 req-26426a72-ee43-49fe-b729-3f40b4182f5a tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 945 time: 0.1290348
Jun 01 10:07:08.294521 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 1.1025236
Jun 01 10:07:08.295181 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 58752) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:08.300270 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] Request body: {'subnet': {'network_id': '07fdf8d3-44fa-4947-b167-16794fbf5df9', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-2096590688-subnet', 'tenant_id': '4dfe4071c865475da8fdf2fb00d78d1a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:07:08.305886 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:08.306887 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-57dabf71-055d-48f8-915e-7b1645fe4356 req-82d21b9e-8e32-4a51-8b7f-fb85b62e5e4e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0713162
Jun 01 10:07:08.310374 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] Usage tracker for resource:subnet and tenant:4dfe4071c865475da8fdf2fb00d78d1a is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:08.317049 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:08.324307 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:08.336344 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-51441f34-99d7-4352-844f-3a9b2bc70811 req-22fb62b2-d42b-4163-bcf1-15b5318002bf tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0483561
Jun 01 10:07:08.434698 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] Made reservation on behalf of 4dfe4071c865475da8fdf2fb00d78d1a for: {'subnet': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:07:08.437103 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] Notify callbacks [] for subnet, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:08.596186 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b9b88bd-c3db-4fce-8097-c928fb5be02a req-3210c9c5-fe6b-4037-b26a-75124cf2d319 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:08.598513 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8b9b88bd-c3db-4fce-8097-c928fb5be02a req-3210c9c5-fe6b-4037-b26a-75124cf2d319 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1758659
Jun 01 10:07:08.607386 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 58772) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:08.619252 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-1ca01a84-ed30-4586-805a-7750c025b0ca tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Request body: {'floatingip': {'port_id': 'ba4fa832-87bd-477b-bad8-2837ab09304a'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:07:08.789928 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1ca01a84-ed30-4586-805a-7750c025b0ca tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for floatingip, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:08.986954 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303'] for subnet, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:08.992684 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:09.008101 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f8c342e-3bc1-4731-9664-f04e59973e17 req-6373bea0-8395-49ae-a3ea-211273757054 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:09.009695 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0f8c342e-3bc1-4731-9664-f04e59973e17 req-6373bea0-8395-49ae-a3ea-211273757054 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.3155661
Jun 01 10:07:09.140923 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] Pushing event updated for resources: {'Subnet': ['ID=42edf4bd-9e0a-4c38-a416-29405b88fab2,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:09.144289 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:09.151261 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] Checking segment: {'id': '718f4e32-457c-4c85-a7dd-a74950675598', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 890, 'network_id': '07fdf8d3-44fa-4947-b167-16794fbf5df9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92565) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:07:09.151609 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] Network hostable DHCP agents. Network: 07fdf8d3-44fa-4947-b167-16794fbf5df9, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92565) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:07:09.195794 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0f8c342e-3bc1-4731-9664-f04e59973e17 req-bebe6a86-259d-4229-8154-5ada8aa015ba tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1756539
Jun 01 10:07:09.281532 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] Network 07fdf8d3-44fa-4947-b167-16794fbf5df9 is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92565) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:07:09.373197 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, 07fdf8d3-44fa-4947-b167-16794fbf5df9) {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:07:09.377479 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:09.378453 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:09.385795 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fcb33581-cc3a-4893-b866-aa8172d5cf1a None None] Network 07fdf8d3-44fa-4947-b167-16794fbf5df9 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:07:09.516553 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.2203612
Jun 01 10:07:09.573634 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15865997-d923-401a-bce3-bce3115e9969 None None] Network 07fdf8d3-44fa-4947-b167-16794fbf5df9 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:07:09.630118 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6258956-03f9-4da1-ba10-cc993be7f2bd req-fb282cb8-89a7-4e28-b51e-1cfc9a34e52b tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:09.637910 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d6258956-03f9-4da1-ba10-cc993be7f2bd req-fb282cb8-89a7-4e28-b51e-1cfc9a34e52b tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 945 time: 0.1719263
Jun 01 10:07:09.808911 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d6258956-03f9-4da1-ba10-cc993be7f2bd req-0da1099e-4d10-4dcf-8614-aa94fe78f00b tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1701252
Jun 01 10:07:09.814366 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1ca01a84-ed30-4586-805a-7750c025b0ca tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:09.893207 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1ca01a84-ed30-4586-805a-7750c025b0ca tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:10.074105 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.l3_db [None req-1ca01a84-ed30-4586-805a-7750c025b0ca tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Floating IP 59c9c8d8-4740-4068-b480-d0c42e3b7761 associated. External IP: 172.27.2.156, port: ba4fa832-87bd-477b-bad8-2837ab09304a.
Jun 01 10:07:10.216398 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 58810) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:10.391548 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bd3fb5d5-5d59-42a6-9a15-50431542d818 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:10.447457 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-bd3fb5d5-5d59-42a6-9a15-50431542d818 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:10.456651 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-bd3fb5d5-5d59-42a6-9a15-50431542d818 admin admin] Usage tracker for resource:security_group_rule and tenant:15f65cfab8a54d838bc2895ac8bcfed8 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:10.465433 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-bd3fb5d5-5d59-42a6-9a15-50431542d818 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:10.474289 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-5c3b2c05-67eb-4b7e-994f-1459ac32647f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:10.477497 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-bd3fb5d5-5d59-42a6-9a15-50431542d818 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:10.580724 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bd3fb5d5-5d59-42a6-9a15-50431542d818 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:10.580860 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 58826) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:10.589163 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-181875400-network', 'tenant_id': '9aa6eb3213e94c79932591b17a24f1e6'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:07:10.599964 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1ca01a84-ed30-4586-805a-7750c025b0ca tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Router d65374d4-451b-4890-a2f5-a4bcac5a9a38 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92566) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:07:10.601342 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:10.609943 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Usage tracker for resource:network and tenant:9aa6eb3213e94c79932591b17a24f1e6 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:10.616869 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:10.625561 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:10.636375 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bd3fb5d5-5d59-42a6-9a15-50431542d818 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:10.645726 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b54b1fa7-5a89-40b1-9575-8acbf53b7960 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:10.685175 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-bd3fb5d5-5d59-42a6-9a15-50431542d818 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=15f65cfab8a54d838bc2895ac8bcfed8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4673576
Jun 01 10:07:10.686388 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd3fb5d5-5d59-42a6-9a15-50431542d818 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c5529ced-88c1-4776-ba32-d150df147809,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:10.689091 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 58830) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:10.691864 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-bd3fb5d5-5d59-42a6-9a15-50431542d818 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:10.714264 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a066015a-1753-4220-9ea8-22c7e763834a req-970d04dc-14f2-43fd-97ee-5983861f2776 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:10.715755 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a066015a-1753-4220-9ea8-22c7e763834a req-970d04dc-14f2-43fd-97ee-5983861f2776 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.2250285
Jun 01 10:07:10.754380 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4eeaf76d-2d5d-4024-98dd-88ada5d63113 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:10.780632 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4eeaf76d-2d5d-4024-98dd-88ada5d63113 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:10.805590 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Made reservation on behalf of 9aa6eb3213e94c79932591b17a24f1e6 for: {'network': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:07:10.807882 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:10.831214 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:10.866679 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:10.874020 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a066015a-1753-4220-9ea8-22c7e763834a req-92a46bf9-3b19-46c6-9957-96acde2ca4c4 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1526792
Jun 01 10:07:10.878280 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Usage tracker for resource:security_group_rule and tenant:9aa6eb3213e94c79932591b17a24f1e6 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:10.883351 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:10.890173 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1ca01a84-ed30-4586-805a-7750c025b0ca tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:07:10.891979 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:10.902374 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1ca01a84-ed30-4586-805a-7750c025b0ca tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:10.910049 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4eeaf76d-2d5d-4024-98dd-88ada5d63113 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:10.912831 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-901d2ece-edad-49e5-89df-c1442355afee None None] Sync routers for ids ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:07:10.916567 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-909a7ba3-5ccd-4036-8ef4-a15a56604cda admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:10.925630 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-901d2ece-edad-49e5-89df-c1442355afee None None] Routers {'d65374d4-451b-4890-a2f5-a4bcac5a9a38'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:07:10.926329 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-901d2ece-edad-49e5-89df-c1442355afee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe728676d0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:06:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:07:10.928107 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eeaf76d-2d5d-4024-98dd-88ada5d63113 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c5529ced-88c1-4776-ba32-d150df147809,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:10.931123 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-4eeaf76d-2d5d-4024-98dd-88ada5d63113 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:10.938252 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4eeaf76d-2d5d-4024-98dd-88ada5d63113 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:10.940535 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-4eeaf76d-2d5d-4024-98dd-88ada5d63113 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/c5529ced-88c1-4776-ba32-d150df147809 HTTP/1.1" status: 204  len: 168 time: 0.2501030
Jun 01 10:07:10.985280 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-1ca01a84-ed30-4586-805a-7750c025b0ca tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "PUT /v2.0/floatingips/59c9c8d8-4740-4068-b480-d0c42e3b7761 HTTP/1.1" status: 200  len: 992 time: 2.3768063
Jun 01 10:07:10.990718 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '77032f84-7f38-4e7e-b0fd-accc20754797', 'tag': 'ba4fa832-87bd-477b-bad8-2837ab09304a'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:07:10.992995 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8f199059-85c5-4243-9861-f4c682b7898b" -d '{"events": [{"name": "network-changed", "server_uuid": "77032f84-7f38-4e7e-b0fd-accc20754797", "tag": "ba4fa832-87bd-477b-bad8-2837ab09304a"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:07:11.103139 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:11.117014 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fccdef4b-4f6c-440e-9f22-59e0517387b5 req-804bf584-468a-40ed-899e-072970976bcf tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:11.120150 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fccdef4b-4f6c-440e-9f22-59e0517387b5 req-804bf584-468a-40ed-899e-072970976bcf tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 945 time: 0.1229138
Jun 01 10:07:11.164764 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-901d2ece-edad-49e5-89df-c1442355afee None None] Set router d65374d4-451b-4890-a2f5-a4bcac5a9a38 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:07:11.177292 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fccdef4b-4f6c-440e-9f22-59e0517387b5 req-aaa01730-9624-4b14-a6b6-9cb4084044f2 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0526271
Jun 01 10:07:11.200710 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:11.205046 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:11.232802 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 858}  {{(pid=92566) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:07:11.245626 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bff6ae57-bbd3-4390-8a28-780205558511,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:11.249179 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:11.251716 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:11.252063 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.segments_db [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Added segment b3d6a80a-0aba-48ca-b258-b98284b9fa94 of type vlan for network 391b86e7-8349-4b96-9a66-5e39bdeadc63
Jun 01 10:07:11.280159 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:11.412760 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:11.414236 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:11.414832 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:11.420161 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:11.522301 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Pushing event updated for resources: {'Network': ['ID=391b86e7-8349-4b96-9a66-5e39bdeadc63,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:11.532506 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:11.534221 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-901d2ece-edad-49e5-89df-c1442355afee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe728676d0>, [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:18Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '59c9c8d8-4740-4068-b480-d0c42e3b7761', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'floating_ip_address': '172.27.2.156', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'port_id': 'ba4fa832-87bd-477b-bad8-2837ab09304a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 124, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'mac_address': 'fa:16:3e:54:58:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '77032f84-7f38-4e7e-b0fd-accc20754797', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:06:32Z', 'updated_at': '2021-06-01T10:07:09Z', 'revision_number': 1, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '476d2473-d40f-4cca-8a85-8b1ea30a5281', 'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'mac_address': 'fa:16:3e:87:a6:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:15Z', 'updated_at': '2021-06-01T10:06:36Z', 'revision_number': 5, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'subnets': [{'id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:07:11.538872 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network 391b86e7-8349-4b96-9a66-5e39bdeadc63 details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:07:11.546231 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-901d2ece-edad-49e5-89df-c1442355afee None None] Checking router: d65374d4-451b-4890-a2f5-a4bcac5a9a38 for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:07:11.556259 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-901d2ece-edad-49e5-89df-c1442355afee None None] Routers {'d65374d4-451b-4890-a2f5-a4bcac5a9a38'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:07:11.557124 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-901d2ece-edad-49e5-89df-c1442355afee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe728676d0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:06:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:07:11.562640 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.9790955
Jun 01 10:07:11.565411 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 58854) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:11.572255 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-84602c9e-9b39-4a8b-a84e-c63e330fd01f admin admin] Request body: {'subnet': {'network_id': '391b86e7-8349-4b96-9a66-5e39bdeadc63', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-181875400-subnet', 'tenant_id': '9aa6eb3213e94c79932591b17a24f1e6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:07:11.579305 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-84602c9e-9b39-4a8b-a84e-c63e330fd01f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:11.583705 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-84602c9e-9b39-4a8b-a84e-c63e330fd01f admin admin] Usage tracker for resource:subnet and tenant:9aa6eb3213e94c79932591b17a24f1e6 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:11.588752 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-84602c9e-9b39-4a8b-a84e-c63e330fd01f admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:11.593723 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-84602c9e-9b39-4a8b-a84e-c63e330fd01f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:11.675513 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-84602c9e-9b39-4a8b-a84e-c63e330fd01f admin admin] Made reservation on behalf of 9aa6eb3213e94c79932591b17a24f1e6 for: {'subnet': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:07:11.678440 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-84602c9e-9b39-4a8b-a84e-c63e330fd01f admin admin] Notify callbacks [] for subnet, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:11.814808 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-901d2ece-edad-49e5-89df-c1442355afee None None] Set router d65374d4-451b-4890-a2f5-a4bcac5a9a38 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:07:12.138610 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-84602c9e-9b39-4a8b-a84e-c63e330fd01f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303'] for subnet, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:12.143908 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:12.180307 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-901d2ece-edad-49e5-89df-c1442355afee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe728676d0>, [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:18Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '59c9c8d8-4740-4068-b480-d0c42e3b7761', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'floating_ip_address': '172.27.2.156', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'port_id': 'ba4fa832-87bd-477b-bad8-2837ab09304a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 124, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'mac_address': 'fa:16:3e:54:58:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '77032f84-7f38-4e7e-b0fd-accc20754797', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:06:32Z', 'updated_at': '2021-06-01T10:07:09Z', 'revision_number': 1, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '476d2473-d40f-4cca-8a85-8b1ea30a5281', 'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'mac_address': 'fa:16:3e:87:a6:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:15Z', 'updated_at': '2021-06-01T10:06:36Z', 'revision_number': 5, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'subnets': [{'id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:07:12.184794 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-901d2ece-edad-49e5-89df-c1442355afee None None] The sync data for ids ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'] in dv-cinder-787262-4-iscsi is: [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:18Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '59c9c8d8-4740-4068-b480-d0c42e3b7761', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'floating_ip_address': '172.27.2.156', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'port_id': 'ba4fa832-87bd-477b-bad8-2837ab09304a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 124, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'mac_address': 'fa:16:3e:54:58:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '77032f84-7f38-4e7e-b0fd-accc20754797', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:06:32Z', 'updated_at': '2021-06-01T10:07:09Z', 'revision_number': 1, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '476d2473-d40f-4cca-8a85-8b1ea30a5281', 'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'mac_address': 'fa:16:3e:87:a6:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:15Z', 'updated_at': '2021-06-01T10:06:36Z', 'revision_number': 5, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'subnets': [{'id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:07:12.304916 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84602c9e-9b39-4a8b-a84e-c63e330fd01f admin admin] Pushing event updated for resources: {'Subnet': ['ID=9a42bfb0-36ef-41e8-9b6b-0e2d90b97341,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:12.309219 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-84602c9e-9b39-4a8b-a84e-c63e330fd01f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:12.315079 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84602c9e-9b39-4a8b-a84e-c63e330fd01f admin admin] Checking segment: {'id': 'b3d6a80a-0aba-48ca-b258-b98284b9fa94', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '391b86e7-8349-4b96-9a66-5e39bdeadc63'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:07:12.315434 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84602c9e-9b39-4a8b-a84e-c63e330fd01f admin admin] Network hostable DHCP agents. Network: 391b86e7-8349-4b96-9a66-5e39bdeadc63, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92566) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:07:12.403560 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-101a1b98-73d5-420a-8ea3-38d8a2b9526e None None] New status for floating IP 59c9c8d8-4740-4068-b480-d0c42e3b7761: ACTIVE {{(pid=92567) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:07:12.407117 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84602c9e-9b39-4a8b-a84e-c63e330fd01f admin admin] Network 391b86e7-8349-4b96-9a66-5e39bdeadc63 is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92566) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:07:12.498270 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-84602c9e-9b39-4a8b-a84e-c63e330fd01f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, 391b86e7-8349-4b96-9a66-5e39bdeadc63) {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:07:12.502498 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84602c9e-9b39-4a8b-a84e-c63e330fd01f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:12.503142 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-84602c9e-9b39-4a8b-a84e-c63e330fd01f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:12.510824 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6c0f10c-a714-436f-bca9-b35f5b3b84ee None None] Network 391b86e7-8349-4b96-9a66-5e39bdeadc63 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:07:12.601170 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-84602c9e-9b39-4a8b-a84e-c63e330fd01f admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.0346410
Jun 01 10:07:12.868538 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d21812d-4094-4d36-b889-68dac2d59c7d None None] Network 391b86e7-8349-4b96-9a66-5e39bdeadc63 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:07:13.052751 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-ad75a365-e12f-4b12-9a8a-2d6e0d125aaf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:13.121899 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:07:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9bd2271f-2454-4224-946f-94630802b706 x-openstack-request-id: req-9bd2271f-2454-4224-946f-94630802b706 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:07:13.122213 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "77032f84-7f38-4e7e-b0fd-accc20754797", "tag": "ba4fa832-87bd-477b-bad8-2837ab09304a", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:07:13.122486 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-9bd2271f-2454-4224-946f-94630802b706 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:07:13.122969 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '77032f84-7f38-4e7e-b0fd-accc20754797', 'tag': 'ba4fa832-87bd-477b-bad8-2837ab09304a', 'status': 'completed', 'code': 200}
Jun 01 10:07:13.241036 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:13.265874 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f199059-85c5-4243-9861-f4c682b7898b req-3dac7832-b44d-41b8-a32c-bec326e40c2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:13.267873 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-8f199059-85c5-4243-9861-f4c682b7898b req-3dac7832-b44d-41b8-a32c-bec326e40c2c service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=f4f6f875519045a39c1fdbadd53ce517&device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 1099 time: 0.1155179
Jun 01 10:07:13.316206 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e804457e-c6de-456b-aa29-3d1e841d8ec5 req-1f672624-200c-4f5b-8faa-a0585934210c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:13.318569 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e804457e-c6de-456b-aa29-3d1e841d8ec5 req-1f672624-200c-4f5b-8faa-a0585934210c tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 945 time: 0.1103301
Jun 01 10:07:13.418816 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e804457e-c6de-456b-aa29-3d1e841d8ec5 req-8288865d-e03a-4d51-afd1-e6074eba0fad tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0937991
Jun 01 10:07:13.456322 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f199059-85c5-4243-9861-f4c682b7898b req-ccb6e24d-7107-4bf7-9766-90d013639f9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:13.457755 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-8f199059-85c5-4243-9861-f4c682b7898b req-ccb6e24d-7107-4bf7-9766-90d013639f9a service neutron] 10.222.0.30 "GET /v2.0/networks?id=be546533-cf92-483d-9e38-7d14ca9c4902 HTTP/1.1" status: 200  len: 917 time: 0.1794417
Jun 01 10:07:13.458543 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b5b597f-e272-4711-a6de-1b28835a0585 req-6a129a90-f4ac-4319-8ce0-b475fe4b3391 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:13.460257 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2b5b597f-e272-4711-a6de-1b28835a0585 req-6a129a90-f4ac-4319-8ce0-b475fe4b3391 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.1206894
Jun 01 10:07:13.507677 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2b5b597f-e272-4711-a6de-1b28835a0585 req-2e3a6c2e-d9ee-4531-becc-fd436ad4656f tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415428
Jun 01 10:07:13.572195 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-8f199059-85c5-4243-9861-f4c682b7898b req-a7ac58ef-a7c1-4eea-a37b-8c2f0b78ca76 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ba4fa832-87bd-477b-bad8-2837ab09304a HTTP/1.1" status: 200  len: 1002 time: 0.1035733
Jun 01 10:07:13.638827 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f199059-85c5-4243-9861-f4c682b7898b req-6df29490-07eb-497d-8fb0-68198c1327be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:13.640362 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-8f199059-85c5-4243-9861-f4c682b7898b req-6df29490-07eb-497d-8fb0-68198c1327be service neutron] 10.222.0.30 "GET /v2.0/subnets?id=f2fdda64-a03c-41d7-8178-daca0363bd6e HTTP/1.1" status: 200  len: 855 time: 0.0608239
Jun 01 10:07:13.720473 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f199059-85c5-4243-9861-f4c682b7898b req-7ee35b6b-743a-4fb0-8c66-aeb5dd87314c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:13.721925 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-8f199059-85c5-4243-9861-f4c682b7898b req-7ee35b6b-743a-4fb0-8c66-aeb5dd87314c service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=be546533-cf92-483d-9e38-7d14ca9c4902&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0739102
Jun 01 10:07:13.875709 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d29ea46-6f4b-4d96-86f8-dd27de5c9292 req-510f7e2d-9fb5-45ad-a5c4-89b77ca50d59 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:13.877001 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-8f199059-85c5-4243-9861-f4c682b7898b req-0f8a9448-46e5-455e-9bc6-507bc718ea34 service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1477289
Jun 01 10:07:13.878779 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1d29ea46-6f4b-4d96-86f8-dd27de5c9292 req-510f7e2d-9fb5-45ad-a5c4-89b77ca50d59 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.30 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 945 time: 0.1085842
Jun 01 10:07:14.011440 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:14.057169 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-8f199059-85c5-4243-9861-f4c682b7898b req-991cb3dd-8ac2-4fbc-b20b-a43305c3df03 service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1693974
Jun 01 10:07:14.065987 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-1d29ea46-6f4b-4d96-86f8-dd27de5c9292 req-f315ac5a-f856-441a-83f3-78864d15e316 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Deleting port 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:07:14.066381 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-1d29ea46-6f4b-4d96-86f8-dd27de5c9292 req-f315ac5a-f856-441a-83f3-78864d15e316 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:14.293140 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-1d29ea46-6f4b-4d96-86f8-dd27de5c9292 req-f315ac5a-f856-441a-83f3-78864d15e316 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] For port 1f8c5c86-a9a1-4720-821c-f7e5d5c18184, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=1f8c5c86-a9a1-4720-821c-f7e5d5c18184,segment=NetworkSegment(db85cbc8-d6a7-4b73-b511-b419c581a2fb),segment_id=db85cbc8-d6a7-4b73-b511-b419c581a2fb)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:07:14.293499 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-1d29ea46-6f4b-4d96-86f8-dd27de5c9292 req-f315ac5a-f856-441a-83f3-78864d15e316 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:14.424097 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-1d29ea46-6f4b-4d96-86f8-dd27de5c9292 req-f315ac5a-f856-441a-83f3-78864d15e316 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Calling delete_port for 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 owned by compute:nova {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:07:14.744371 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7327f3f5-b8ac-423b-a2a1-5fa53f15643f req-92b246ff-9aa9-4162-9d9c-d6b7aebcc361 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:14.746028 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7327f3f5-b8ac-423b-a2a1-5fa53f15643f req-92b246ff-9aa9-4162-9d9c-d6b7aebcc361 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 945 time: 0.1737497
Jun 01 10:07:14.755167 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe2724e3-6258-4483-89ff-a93cf6e15c7e req-503c3380-560c-410d-bb4a-c3cb897a6540 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:14.756670 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fe2724e3-6258-4483-89ff-a93cf6e15c7e req-503c3380-560c-410d-bb4a-c3cb897a6540 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.1307294
Jun 01 10:07:14.824989 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-1d29ea46-6f4b-4d96-86f8-dd27de5c9292 req-f315ac5a-f856-441a-83f3-78864d15e316 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:14.831301 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7327f3f5-b8ac-423b-a2a1-5fa53f15643f req-ea9707b9-edaf-4503-8892-0a45853162ea tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/security-groups?id=359b5e3e-b771-4b76-a686-039a3ab485cd&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0737264
Jun 01 10:07:14.840004 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:14.840345 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['1f8c5c86-a9a1-4720-821c-f7e5d5c18184'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:07:14.872153 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fe2724e3-6258-4483-89ff-a93cf6e15c7e req-247e70e4-67af-4642-950b-937637ca87e2 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0984898
Jun 01 10:07:14.888610 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f315ac5a-f856-441a-83f3-78864d15e316 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Pushing event deleted for resources: {'Port': ['ID=1f8c5c86-a9a1-4720-821c-f7e5d5c18184,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:14.926262 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f315ac5a-f856-441a-83f3-78864d15e316 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:14.973606 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-1d29ea46-6f4b-4d96-86f8-dd27de5c9292 req-f315ac5a-f856-441a-83f3-78864d15e316 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] No DVR routers for this DVR port 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 on host hv-cinder-78726 {{(pid=92566) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:07:14.981346 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-1d29ea46-6f4b-4d96-86f8-dd27de5c9292 req-f315ac5a-f856-441a-83f3-78864d15e316 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:14.992214 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1d29ea46-6f4b-4d96-86f8-dd27de5c9292 req-f315ac5a-f856-441a-83f3-78864d15e316 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.30 "DELETE /v2.0/ports/1f8c5c86-a9a1-4720-821c-f7e5d5c18184 HTTP/1.1" status: 204  len: 173 time: 1.1032200
Jun 01 10:07:15.124195 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2abcfd9c-55d9-46ea-8a25-6a89998bf874', 'name': 'network-vif-deleted', 'tag': '1f8c5c86-a9a1-4720-821c-f7e5d5c18184'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:07:15.126693 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-849378c8-7e88-44d8-877d-46d1c8aff876" -d '{"events": [{"server_uuid": "2abcfd9c-55d9-46ea-8a25-6a89998bf874", "name": "network-vif-deleted", "tag": "1f8c5c86-a9a1-4720-821c-f7e5d5c18184"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:07:15.169490 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:07:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-993ff520-c76e-49ff-bead-ebde62b9a01b x-openstack-request-id: req-993ff520-c76e-49ff-bead-ebde62b9a01b {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:07:15.169800 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2abcfd9c-55d9-46ea-8a25-6a89998bf874", "name": "network-vif-deleted", "tag": "1f8c5c86-a9a1-4720-821c-f7e5d5c18184", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:07:15.170071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-993ff520-c76e-49ff-bead-ebde62b9a01b {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:07:15.170486 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2abcfd9c-55d9-46ea-8a25-6a89998bf874', 'name': 'network-vif-deleted', 'tag': '1f8c5c86-a9a1-4720-821c-f7e5d5c18184', 'status': 'completed', 'code': 200}
Jun 01 10:07:15.788106 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:16.045259 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-844b8595-cde2-42d2-b1a5-ffbf1f41517c req-59e20d73-6ae7-453b-b4c1-054b0374acef tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Synchronizing usage tracker for tenant:17dcefd313724cf2abaacb81a9e0729c on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:07:16.097565 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3499db5-130d-4f3b-be11-83184c7cd249 req-d24a09e2-37dd-46dc-86bc-7bc2a9230cfa tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:16.099600 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d3499db5-130d-4f3b-be11-83184c7cd249 req-d24a09e2-37dd-46dc-86bc-7bc2a9230cfa tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.1004527
Jun 01 10:07:16.152372 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d3499db5-130d-4f3b-be11-83184c7cd249 req-ebb3c4c0-8d1b-4d5e-8d5b-74c389c6d9d9 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429282
Jun 01 10:07:16.153560 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-844b8595-cde2-42d2-b1a5-ffbf1f41517c req-59e20d73-6ae7-453b-b4c1-054b0374acef tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Unset dirty status for tenant:17dcefd313724cf2abaacb81a9e0729c on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:07:16.155047 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-844b8595-cde2-42d2-b1a5-ffbf1f41517c req-59e20d73-6ae7-453b-b4c1-054b0374acef tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] 10.222.0.68 "GET /v2.0/ports?device_id=2abcfd9c-55d9-46ea-8a25-6a89998bf874 HTTP/1.1" status: 200  len: 210 time: 0.1874189
Jun 01 10:07:17.367462 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f8a5e26-b966-4a4e-bf43-b7aeca2125bd req-257b91b8-b55c-4212-933e-5fe8c9733c21 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:17.368910 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3f8a5e26-b966-4a4e-bf43-b7aeca2125bd req-257b91b8-b55c-4212-933e-5fe8c9733c21 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.0911100
Jun 01 10:07:17.415268 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3f8a5e26-b966-4a4e-bf43-b7aeca2125bd req-f7cf3097-0678-4299-ab39-9a9087014065 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401628
Jun 01 10:07:17.823912 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:07:17.859573 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:07:17.859915 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 1f8c5c86-a9a1-4720-821c-f7e5d5c18184 not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:07:18.642759 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09e9b662-156c-4da5-b957-dae522d07dc7 req-41f38f4d-3259-488a-a900-e46bf362aec7 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:18.644684 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-09e9b662-156c-4da5-b957-dae522d07dc7 req-41f38f4d-3259-488a-a900-e46bf362aec7 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.1179476
Jun 01 10:07:18.786565 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-09e9b662-156c-4da5-b957-dae522d07dc7 req-a26d0d4e-2416-44fd-b9e2-7be21ecff6cd tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1346476
Jun 01 10:07:19.172728 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59080) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:19.295711 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8025f48f-1bb0-4eb7-8faa-9fd2cab3ec88 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:19.310707 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-8025f48f-1bb0-4eb7-8faa-9fd2cab3ec88 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:19.314605 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-8025f48f-1bb0-4eb7-8faa-9fd2cab3ec88 admin admin] Usage tracker for resource:security_group_rule and tenant:2e94f4cb160d4b9497b1280708912974 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:19.318501 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-8025f48f-1bb0-4eb7-8faa-9fd2cab3ec88 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:19.324469 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-8025f48f-1bb0-4eb7-8faa-9fd2cab3ec88 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:19.408796 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8025f48f-1bb0-4eb7-8faa-9fd2cab3ec88 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:19.555607 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8025f48f-1bb0-4eb7-8faa-9fd2cab3ec88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:19.564687 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:19.600937 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-8025f48f-1bb0-4eb7-8faa-9fd2cab3ec88 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=2e94f4cb160d4b9497b1280708912974&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4268234
Jun 01 10:07:19.603734 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 59088) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:19.605128 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8025f48f-1bb0-4eb7-8faa-9fd2cab3ec88 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f7724602-360e-471f-ad30-dabed266e6b8,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:19.608149 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8025f48f-1bb0-4eb7-8faa-9fd2cab3ec88 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:19.666658 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fb66b956-6c90-49b8-80ba-21f84583b405 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:19.695386 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fb66b956-6c90-49b8-80ba-21f84583b405 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:19.847249 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fb66b956-6c90-49b8-80ba-21f84583b405 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:19.866829 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-2b607bb4-1650-4e1c-b9b6-0f4dd8287167 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:19.897120 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb66b956-6c90-49b8-80ba-21f84583b405 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7724602-360e-471f-ad30-dabed266e6b8,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:19.907279 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fb66b956-6c90-49b8-80ba-21f84583b405 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:19.919714 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-fb66b956-6c90-49b8-80ba-21f84583b405 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/f7724602-360e-471f-ad30-dabed266e6b8 HTTP/1.1" status: 204  len: 168 time: 0.3088613
Jun 01 10:07:19.921268 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-fb66b956-6c90-49b8-80ba-21f84583b405 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:20.016024 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe9ea9cb-e494-4e3f-8d2a-543116e88267 req-084e019d-7337-4e86-a29a-4331caf4f272 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:20.017626 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fe9ea9cb-e494-4e3f-8d2a-543116e88267 req-084e019d-7337-4e86-a29a-4331caf4f272 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.1131277
Jun 01 10:07:20.088980 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fe9ea9cb-e494-4e3f-8d2a-543116e88267 req-b4de0db9-a1b8-4845-b11e-51f29779243c tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0609818
Jun 01 10:07:20.261930 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59118) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:20.330936 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_v2 [None req-f6ac4bcf-8e7e-4d3c-98e4-bf08ae2f7ea4 admin admin] Deleting subnet acb0c106-1f4c-4cf1-9985-fb4e642b58bb {{(pid=92565) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 10:07:20.335412 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f6ac4bcf-8e7e-4d3c-98e4-bf08ae2f7ea4 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:20.346366 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-22fa4efb-8574-480e-b0ca-eb34fb441235 req-8de593a2-0c6b-46ba-9781-16d4bdf28834 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0968442
Jun 01 10:07:20.391980 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f6ac4bcf-8e7e-4d3c-98e4-bf08ae2f7ea4 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:20.407884 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f6ac4bcf-8e7e-4d3c-98e4-bf08ae2f7ea4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7791835'] for subnet, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:20.510358 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22fa4efb-8574-480e-b0ca-eb34fb441235 req-5bfe237f-16d0-41fb-9e4a-70fe442919b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:20.511860 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-22fa4efb-8574-480e-b0ca-eb34fb441235 req-5bfe237f-16d0-41fb-9e4a-70fe442919b1 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=ef4bc75ba53a44cca2e4b7c2b8aeb818&device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 1098 time: 0.0767870
Jun 01 10:07:20.652812 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59128) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:20.660476 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22fa4efb-8574-480e-b0ca-eb34fb441235 req-a0b4dac0-fe83-45a5-ba85-928ab4a6c4e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:20.662558 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-22fa4efb-8574-480e-b0ca-eb34fb441235 req-a0b4dac0-fe83-45a5-ba85-928ab4a6c4e3 service neutron] 10.222.0.30 "GET /v2.0/networks?id=34268ce8-8baf-41d5-acbc-1b6c167dd481 HTTP/1.1" status: 200  len: 920 time: 0.1302457
Jun 01 10:07:20.676324 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9df202d8-829c-429b-852d-c35434d77395 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:20.694637 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-9df202d8-829c-429b-852d-c35434d77395 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:20.698858 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-9df202d8-829c-429b-852d-c35434d77395 admin admin] Usage tracker for resource:security_group_rule and tenant:caecf18551014218a3ea9f9d1bfe6fed is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:20.701835 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-9df202d8-829c-429b-852d-c35434d77395 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:20.707663 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-9df202d8-829c-429b-852d-c35434d77395 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:20.734132 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-22fa4efb-8574-480e-b0ca-eb34fb441235 req-89fae86d-e138-47b4-8e22-e508502d85a7 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=18b5c352-ee0c-425b-a1bf-666d362844b9 HTTP/1.1" status: 200  len: 217 time: 0.0637074
Jun 01 10:07:20.816821 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22fa4efb-8574-480e-b0ca-eb34fb441235 req-def5f09f-4dc1-4132-b281-eb71b53a6488 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:20.818813 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-22fa4efb-8574-480e-b0ca-eb34fb441235 req-def5f09f-4dc1-4132-b281-eb71b53a6488 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2ee54c26-f286-4f9a-b791-24aa84feb26a HTTP/1.1" status: 200  len: 859 time: 0.0778747
Jun 01 10:07:20.827072 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9df202d8-829c-429b-852d-c35434d77395 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:20.835864 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f6ac4bcf-8e7e-4d3c-98e4-bf08ae2f7ea4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7793006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303'] for subnet, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:20.847626 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:20.874739 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-22fa4efb-8574-480e-b0ca-eb34fb441235 req-e1f4f5e7-fcba-4d5c-9065-bff13acdb9a5 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=34268ce8-8baf-41d5-acbc-1b6c167dd481&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0468347
Jun 01 10:07:20.879511 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 59138) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:20.883206 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f6ac4bcf-8e7e-4d3c-98e4-bf08ae2f7ea4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:20.891786 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6ac4bcf-8e7e-4d3c-98e4-bf08ae2f7ea4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=acb0c106-1f4c-4cf1-9985-fb4e642b58bb,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:20.901901 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f6ac4bcf-8e7e-4d3c-98e4-bf08ae2f7ea4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:20.915807 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-f6ac4bcf-8e7e-4d3c-98e4-bf08ae2f7ea4 admin admin] 10.222.0.68 "DELETE /v2.0/subnets/acb0c106-1f4c-4cf1-9985-fb4e642b58bb HTTP/1.1" status: 204  len: 168 time: 0.6520452
Jun 01 10:07:20.918249 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59144) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:21.028447 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fb76229d-42c9-4220-9ce0-6b687374745c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.062159 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-22fa4efb-8574-480e-b0ca-eb34fb441235 req-d056129c-0c42-4674-814c-a3aaa1d1df65 service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1768773
Jun 01 10:07:21.063078 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-fb76229d-42c9-4220-9ce0-6b687374745c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:21.067157 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-fb76229d-42c9-4220-9ce0-6b687374745c admin admin] Usage tracker for resource:security_group_rule and tenant:0a4175f901714865a36fa372503c7e50 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:21.070154 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-fb76229d-42c9-4220-9ce0-6b687374745c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:21.084583 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9df202d8-829c-429b-852d-c35434d77395 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.094536 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-fb76229d-42c9-4220-9ce0-6b687374745c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:21.116874 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:21.155178 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7813807'] for network, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.170877 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-9df202d8-829c-429b-852d-c35434d77395 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=caecf18551014218a3ea9f9d1bfe6fed&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5171065
Jun 01 10:07:21.175107 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59154) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:21.215480 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9df202d8-829c-429b-852d-c35434d77395 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=823346e8-e2e5-41c5-9bbf-1872d485cf08,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:21.222018 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-9df202d8-829c-429b-852d-c35434d77395 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:21.296987 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-22fa4efb-8574-480e-b0ca-eb34fb441235 req-c6428f35-624e-4ecd-b802-f35926d1ab27 service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2236202
Jun 01 10:07:21.365055 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c350f050-f3a0-475a-b1fa-5dab961e7e5f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.369028 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7795028', 'neutron.services.segments.db._delete_segments_for_network-8726958294492'] for network, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.372822 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58a3a8f4-fe1c-4002-b7a0-8bc79907005d req-7c94ea21-29d0-4db4-875c-dd2a30e813bd tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:21.374310 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-58a3a8f4-fe1c-4002-b7a0-8bc79907005d req-7c94ea21-29d0-4db4-875c-dd2a30e813bd tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.1691647
Jun 01 10:07:21.390978 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7efe712d29d0>> segment before_delete 55550000 {{(pid=92565) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:07:21.391321 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7efe712d29d0>> subnet precommit_delete_associations 55550000 {{(pid=92565) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:07:21.395839 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7efe71d018e0>> segment_host_mapping after_create 55550000 {{(pid=92565) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:07:21.395839 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7efe71d018e0>> port after_create 55550000 {{(pid=92565) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:07:21.395839 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7efe71d018e0>> port after_delete 55550000 {{(pid=92565) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:07:21.395839 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7efe71d018e0>> port after_update 55550000 {{(pid=92565) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:07:21.395839 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7efe71d018e0>> segment after_delete 55550000 {{(pid=92565) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:07:21.395839 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7efe71d018e0>> subnet after_create 55550000 {{(pid=92565) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:07:21.395839 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7efe71d018e0>> subnet after_delete 55550000 {{(pid=92565) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:07:21.395839 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7efe71d018e0>> subnet after_update 55550000 {{(pid=92565) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:07:21.404801 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fb76229d-42c9-4220-9ce0-6b687374745c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.432473 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-58a3a8f4-fe1c-4002-b7a0-8bc79907005d req-bf7e4e43-4565-4864-8e51-26e74bd2b9d5 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0481021
Jun 01 10:07:21.498392 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fb76229d-42c9-4220-9ce0-6b687374745c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.508028 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-36f63b2c-3170-42f0-b7f0-4df781ec4d4c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:21.513051 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7efe711e1a60>> subnet after_create 55550000 {{(pid=92565) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:07:21.513428 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7efe711e1a60>> subnet after_delete 55550000 {{(pid=92565) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:07:21.513835 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7efe711e1a60>> subnet before_create 55550000 {{(pid=92565) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:07:21.514243 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7efe711e1a60>> subnet before_update 55550000 {{(pid=92565) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:07:21.514583 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7efe721a3700>,) {'filters': {'network_id': ['fc9aa7d4-2600-448e-b2e4-9004cbcee079']}} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:07:21.539345 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7efe721a3700>, 'db85cbc8-d6a7-4b73-b511-b419c581a2fb') {'for_net_delete': True} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:07:21.539658 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7efe721a3700>, 'db85cbc8-d6a7-4b73-b511-b419c581a2fb') {} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:07:21.551593 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-fb76229d-42c9-4220-9ce0-6b687374745c admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=0a4175f901714865a36fa372503c7e50&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6739130
Jun 01 10:07:21.554364 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c350f050-f3a0-475a-b1fa-5dab961e7e5f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.554990 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 59160) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:21.559188 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb76229d-42c9-4220-9ce0-6b687374745c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1886d558-052a-41f9-910e-b3f6259f16bf,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:21.566515 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726958303133', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2998472'] for segment, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.588201 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-fb76229d-42c9-4220-9ce0-6b687374745c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:21.599897 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.615043 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Releasing vlan 882 on physical network physnet1 to pool {{(pid=92565) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 10:07:21.615773 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2295757'] for segment, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:   from cryptography.utils import int_from_bytes
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:   from cryptography.utils import int_from_bytes
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]: Traceback (most recent call last):
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:     timer()
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:     cb(*args, **kw)
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:     return func(*args, **kwargs)
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:     self._notify()
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:     self.callback(batched_events)
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:     event.method(event)
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:     return f(self, *a, **k)
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._get(url).json()
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self.request(url, 'GET', **kwargs)
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 10:07:21.637092 dv-cinder-787262-4-iscsi neutron-server[92565]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 10:07:21.660252 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7b29c741-c161-433d-a0cf-f632e7a7eaaa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.692046 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7b29c741-c161-433d-a0cf-f632e7a7eaaa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.813086 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c350f050-f3a0-475a-b1fa-5dab961e7e5f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.815977 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-bd3fb5d5-5d59-42a6-9a15-50431542d818 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:21.831254 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c350f050-f3a0-475a-b1fa-5dab961e7e5f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=823346e8-e2e5-41c5-9bbf-1872d485cf08,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:21.835037 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c350f050-f3a0-475a-b1fa-5dab961e7e5f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:21.870321 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7b29c741-c161-433d-a0cf-f632e7a7eaaa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.872673 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7795037', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-403638'] for network, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.879203 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:21.880966 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.886035 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:21.892169 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b29c741-c161-433d-a0cf-f632e7a7eaaa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1886d558-052a-41f9-910e-b3f6259f16bf,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:21.913276 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Pushing event deleted for resources: {'Network': ['ID=fc9aa7d4-2600-448e-b2e4-9004cbcee079,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:21.915301 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7b29c741-c161-433d-a0cf-f632e7a7eaaa admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.919574 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:21.919845 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-7b29c741-c161-433d-a0cf-f632e7a7eaaa admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/1886d558-052a-41f9-910e-b3f6259f16bf HTTP/1.1" status: 204  len: 168 time: 0.3606796
Jun 01 10:07:21.919845 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7b29c741-c161-433d-a0cf-f632e7a7eaaa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:21.920032 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] 10.222.0.68 "DELETE /v2.0/networks/fc9aa7d4-2600-448e-b2e4-9004cbcee079 HTTP/1.1" status: 204  len: 168 time: 0.9994323
Jun 01 10:07:21.921071 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c350f050-f3a0-475a-b1fa-5dab961e7e5f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:21.922011 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-c350f050-f3a0-475a-b1fa-5dab961e7e5f admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/823346e8-e2e5-41c5-9bbf-1872d485cf08 HTTP/1.1" status: 204  len: 168 time: 0.7373111
Jun 01 10:07:22.444287 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59184) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:22.549241 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 59192) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:22.553883 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-3ecc2958-0857-4634-8489-e3d1217c246b admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=17dcefd313724cf2abaacb81a9e0729c&name=default HTTP/1.1" status: 200  len: 2975 time: 0.1037359
Jun 01 10:07:22.676040 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-36d784ec-dccc-47ab-adc7-8b61133b7c29 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:22.715420 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b710e98-0187-458b-80df-c30766f030b9 req-ed02ae43-2ba5-4076-b060-d0f8bb2ce470 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:22.716880 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1b710e98-0187-458b-80df-c30766f030b9 req-ed02ae43-2ba5-4076-b060-d0f8bb2ce470 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.1415324
Jun 01 10:07:22.718583 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-36d784ec-dccc-47ab-adc7-8b61133b7c29 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:22.881979 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1b710e98-0187-458b-80df-c30766f030b9 req-84ebf11f-bc19-4d00-9b3f-6ef903c671f5 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0788815
Jun 01 10:07:22.949754 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-36d784ec-dccc-47ab-adc7-8b61133b7c29 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:22.954964 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:22.969414 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36d784ec-dccc-47ab-adc7-8b61133b7c29 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=359b5e3e-b771-4b76-a686-039a3ab485cd,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:22.972669 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-36d784ec-dccc-47ab-adc7-8b61133b7c29 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:23.056848 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-36d784ec-dccc-47ab-adc7-8b61133b7c29 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:23.058114 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-36d784ec-dccc-47ab-adc7-8b61133b7c29 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/359b5e3e-b771-4b76-a686-039a3ab485cd HTTP/1.1" status: 204  len: 168 time: 0.5075557
Jun 01 10:07:23.060509 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 59210) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:23.077638 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ea7d5152-c3a0-41fb-ac45-913b80c5b144 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:23.096131 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-ea7d5152-c3a0-41fb-ac45-913b80c5b144 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:23.100101 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-ea7d5152-c3a0-41fb-ac45-913b80c5b144 admin admin] Usage tracker for resource:security_group_rule and tenant:6a2a631fa06c4d5eaa2ac344b7a096df is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:23.103132 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-ea7d5152-c3a0-41fb-ac45-913b80c5b144 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:23.109091 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-ea7d5152-c3a0-41fb-ac45-913b80c5b144 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:23.202531 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ea7d5152-c3a0-41fb-ac45-913b80c5b144 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:23.310490 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ea7d5152-c3a0-41fb-ac45-913b80c5b144 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:23.321839 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a85c2d57-4786-4825-82b6-5dcf42d903a9 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:23.362213 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea7d5152-c3a0-41fb-ac45-913b80c5b144 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1fae1133-2736-47d2-bc70-39550cc63739,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:23.367272 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-ea7d5152-c3a0-41fb-ac45-913b80c5b144 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:23.375062 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-ea7d5152-c3a0-41fb-ac45-913b80c5b144 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=6a2a631fa06c4d5eaa2ac344b7a096df&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3113277
Jun 01 10:07:23.375196 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59232) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:23.439777 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-91796621-0211-4b79-a2b6-0609d0a4ade6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:23.463252 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-91796621-0211-4b79-a2b6-0609d0a4ade6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:23.588272 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-91796621-0211-4b79-a2b6-0609d0a4ade6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:23.593260 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7b05623e-e680-4c87-ae55-8ade56bd349a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:23.605509 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91796621-0211-4b79-a2b6-0609d0a4ade6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1fae1133-2736-47d2-bc70-39550cc63739,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:23.616093 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-91796621-0211-4b79-a2b6-0609d0a4ade6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:23.620492 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-91796621-0211-4b79-a2b6-0609d0a4ade6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:23.624300 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-91796621-0211-4b79-a2b6-0609d0a4ade6 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/1fae1133-2736-47d2-bc70-39550cc63739 HTTP/1.1" status: 204  len: 168 time: 0.2477307
Jun 01 10:07:24.006882 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ba241e-eaca-412e-9d6e-ee83579fa689 req-58ace25b-36fe-4368-9637-910f925256c2 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:24.010730 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d2ba241e-eaca-412e-9d6e-ee83579fa689 req-58ace25b-36fe-4368-9637-910f925256c2 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.0906935
Jun 01 10:07:24.067549 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d2ba241e-eaca-412e-9d6e-ee83579fa689 req-4f72b8c4-a976-4a28-ad72-33a0cf0c4466 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0528903
Jun 01 10:07:24.717944 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59302) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:24.965453 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f6318710-3ba0-4fe1-8df5-009c49c8baa7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:24.980929 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-f6318710-3ba0-4fe1-8df5-009c49c8baa7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:24.984698 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f6318710-3ba0-4fe1-8df5-009c49c8baa7 admin admin] Usage tracker for resource:security_group_rule and tenant:6936370202604654aee0d45f22de8a83 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:24.987480 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f6318710-3ba0-4fe1-8df5-009c49c8baa7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:24.993846 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-f6318710-3ba0-4fe1-8df5-009c49c8baa7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:25.092462 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f6318710-3ba0-4fe1-8df5-009c49c8baa7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:25.161075 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f6318710-3ba0-4fe1-8df5-009c49c8baa7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:25.171220 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c350f050-f3a0-475a-b1fa-5dab961e7e5f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:25.221280 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6318710-3ba0-4fe1-8df5-009c49c8baa7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=680f6ad6-01aa-407a-b2cb-c21266e51efc,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:25.226216 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-f6318710-3ba0-4fe1-8df5-009c49c8baa7 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=6936370202604654aee0d45f22de8a83&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5065053
Jun 01 10:07:25.229213 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59328) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:25.241717 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f6318710-3ba0-4fe1-8df5-009c49c8baa7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:25.365658 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0f65d0d5-ccfd-44a9-ada3-cc4f8afbdb4d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:25.400792 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0f65d0d5-ccfd-44a9-ada3-cc4f8afbdb4d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:25.409619 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48d05886-8d22-4e82-9845-7131bade3fb2 req-ebcc015f-b35d-457a-8b11-14b3df8ba20d tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:25.418383 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-48d05886-8d22-4e82-9845-7131bade3fb2 req-ebcc015f-b35d-457a-8b11-14b3df8ba20d tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.2360106
Jun 01 10:07:25.483444 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-48d05886-8d22-4e82-9845-7131bade3fb2 req-f89e713a-936d-4048-ae90-40ba5b83d5d8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0640967
Jun 01 10:07:25.608607 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0f65d0d5-ccfd-44a9-ada3-cc4f8afbdb4d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:25.617243 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-cb3eb52b-8828-4ec4-882a-4ba83f65fcab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:25.634341 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f65d0d5-ccfd-44a9-ada3-cc4f8afbdb4d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=680f6ad6-01aa-407a-b2cb-c21266e51efc,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:25.637818 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-0f65d0d5-ccfd-44a9-ada3-cc4f8afbdb4d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:25.639279 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0f65d0d5-ccfd-44a9-ada3-cc4f8afbdb4d admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:25.640551 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-0f65d0d5-ccfd-44a9-ada3-cc4f8afbdb4d admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/680f6ad6-01aa-407a-b2cb-c21266e51efc HTTP/1.1" status: 204  len: 168 time: 0.4027543
Jun 01 10:07:26.078098 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59402) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:26.150171 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:26.327305 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-dd0bbcb0-dc27-464a-b305-7327860f3250 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:26.342241 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-dd0bbcb0-dc27-464a-b305-7327860f3250 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:26.346359 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-dd0bbcb0-dc27-464a-b305-7327860f3250 admin admin] Usage tracker for resource:security_group_rule and tenant:26886a66a8414aac9a525062273e5086 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:26.349947 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-dd0bbcb0-dc27-464a-b305-7327860f3250 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:26.356160 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-dd0bbcb0-dc27-464a-b305-7327860f3250 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:26.443531 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-dd0bbcb0-dc27-464a-b305-7327860f3250 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:26.538520 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-dd0bbcb0-dc27-464a-b305-7327860f3250 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:26.566667 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-d8f3f62c-6a15-420d-a3fc-20066fe83a13 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:26.597164 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-dd0bbcb0-dc27-464a-b305-7327860f3250 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=26886a66a8414aac9a525062273e5086&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5177865
Jun 01 10:07:26.599262 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd0bbcb0-dc27-464a-b305-7327860f3250 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b6b3ec28-ef40-4761-8690-18c915f848ea,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:26.600285 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 59426) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:26.603108 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-dd0bbcb0-dc27-464a-b305-7327860f3250 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:26.739713 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1fd8cd85-42e7-4b88-bd81-39c76d317088 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:26.788010 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1fd8cd85-42e7-4b88-bd81-39c76d317088 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:26.851777 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52880e34-9d66-4210-895c-3ae5a1205639 req-2eae904c-0d8e-496c-9a0b-b75c5951c9c7 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:26.853324 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-52880e34-9d66-4210-895c-3ae5a1205639 req-2eae904c-0d8e-496c-9a0b-b75c5951c9c7 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.1586127
Jun 01 10:07:26.924179 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-52880e34-9d66-4210-895c-3ae5a1205639 req-f4c2f443-799a-4377-89b1-9dcf12a7b4dc tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0566328
Jun 01 10:07:26.973913 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1fd8cd85-42e7-4b88-bd81-39c76d317088 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:26.981207 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a1f8c834-21ec-47cd-8e0d-a093cf70a90f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:27.001574 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fd8cd85-42e7-4b88-bd81-39c76d317088 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b6b3ec28-ef40-4761-8690-18c915f848ea,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:27.021228 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1fd8cd85-42e7-4b88-bd81-39c76d317088 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:27.030425 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1fd8cd85-42e7-4b88-bd81-39c76d317088 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:27.031585 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-1fd8cd85-42e7-4b88-bd81-39c76d317088 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/b6b3ec28-ef40-4761-8690-18c915f848ea HTTP/1.1" status: 204  len: 168 time: 0.4303405
Jun 01 10:07:27.181969 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 59456) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:27.406245 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1135572809-network', 'tenant_id': 'bf05ff611bcf4202aee423d3ef734d15'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:07:27.410960 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:27.415569 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Usage tracker for resource:network and tenant:bf05ff611bcf4202aee423d3ef734d15 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:27.420505 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:27.425852 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:27.521240 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Made reservation on behalf of bf05ff611bcf4202aee423d3ef734d15 for: {'network': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:07:27.524462 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:27.537305 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:27.551338 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:27.556041 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Usage tracker for resource:security_group_rule and tenant:bf05ff611bcf4202aee423d3ef734d15 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:27.559121 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:27.565348 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:27.654432 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:27.725472 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:27.728695 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-84c3df7e-bbd0-45c5-a42a-484ef5c3aede admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:27.762072 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 884}  {{(pid=92566) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:07:27.765418 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59486) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:27.774400 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:27.777473 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:27.782720 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:27.783115 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.segments_db [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Added segment a3eadacc-bc0f-438c-ba22-4e06ebfeec11 of type vlan for network 3794c3e5-fe1f-49fc-8746-7fe7f2154093
Jun 01 10:07:27.793450 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-14719683-3719-4fbc-aa92-87f64e630b07 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:27.810540 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-14719683-3719-4fbc-aa92-87f64e630b07 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:27.815642 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-14719683-3719-4fbc-aa92-87f64e630b07 admin admin] Usage tracker for resource:security_group_rule and tenant:7aeb754af8de4ee5984166b53d99ae68 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:27.815835 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:27.818773 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-14719683-3719-4fbc-aa92-87f64e630b07 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:27.831001 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-14719683-3719-4fbc-aa92-87f64e630b07 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:27.838923 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 59492) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:27.938244 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-14719683-3719-4fbc-aa92-87f64e630b07 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:28.100767 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7a2430b4-26c7-409b-bfab-6081cd31bf6a admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:28.118627 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:28.124787 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:28.126292 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:28.131515 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:28.157624 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-7a2430b4-26c7-409b-bfab-6081cd31bf6a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:28.171177 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-7a2430b4-26c7-409b-bfab-6081cd31bf6a admin admin] Usage tracker for resource:security_group_rule and tenant:4c33068f9cf14d8f80664e44416331ac is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:28.184030 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-14719683-3719-4fbc-aa92-87f64e630b07 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:28.194945 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f6318710-3ba0-4fe1-8df5-009c49c8baa7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:28.232592 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-7a2430b4-26c7-409b-bfab-6081cd31bf6a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:28.258113 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-7a2430b4-26c7-409b-bfab-6081cd31bf6a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:28.263619 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-14719683-3719-4fbc-aa92-87f64e630b07 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=7aeb754af8de4ee5984166b53d99ae68&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4942291
Jun 01 10:07:28.263619 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14719683-3719-4fbc-aa92-87f64e630b07 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ef3acf29-a3c1-44d4-a1c8-fa97916f5871,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:28.264916 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59508) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:28.267996 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-14719683-3719-4fbc-aa92-87f64e630b07 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:28.332381 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bd0e3008-415e-404e-9294-7feaaea9d898 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:28.339058 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 1.1557324
Jun 01 10:07:28.341873 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Pushing event updated for resources: {'Network': ['ID=3794c3e5-fe1f-49fc-8746-7fe7f2154093,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:28.342086 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59512) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:28.345133 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:28.352948 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network 3794c3e5-fe1f-49fc-8746-7fe7f2154093 details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:07:28.353615 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] Request body: {'subnet': {'network_id': '3794c3e5-fe1f-49fc-8746-7fe7f2154093', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1135572809-subnet', 'tenant_id': 'bf05ff611bcf4202aee423d3ef734d15', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:07:28.359525 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:28.374955 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] Usage tracker for resource:subnet and tenant:bf05ff611bcf4202aee423d3ef734d15 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:28.381143 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:28.385561 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bd0e3008-415e-404e-9294-7feaaea9d898 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:28.392479 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4decc194-5e42-4ba1-a4b5-1c4bd02c8c6b req-7b3905e4-0a3e-4392-80f3-d3ebef1508e1 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:28.393938 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4decc194-5e42-4ba1-a4b5-1c4bd02c8c6b req-7b3905e4-0a3e-4392-80f3-d3ebef1508e1 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.3419087
Jun 01 10:07:28.399163 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:28.428385 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b885b980-bff6-46d7-ba0b-cc084223af7f req-dc426aec-003b-4dc4-9a21-888ae9d544e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:28.429896 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b885b980-bff6-46d7-ba0b-cc084223af7f req-dc426aec-003b-4dc4-9a21-888ae9d544e7 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 1099 time: 0.1692929
Jun 01 10:07:28.482656 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4decc194-5e42-4ba1-a4b5-1c4bd02c8c6b req-a5a15d5f-b003-476f-991c-7edda62b9e59 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0745618
Jun 01 10:07:28.495689 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b885b980-bff6-46d7-ba0b-cc084223af7f req-cc5d775a-b9ee-4d96-a774-43733b8ee7d8 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0553801
Jun 01 10:07:28.497056 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] Made reservation on behalf of bf05ff611bcf4202aee423d3ef734d15 for: {'subnet': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:07:28.499185 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3139364'] for subnet, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:28.558776 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7a2430b4-26c7-409b-bfab-6081cd31bf6a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:28.639456 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7a2430b4-26c7-409b-bfab-6081cd31bf6a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:28.647588 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-e5bc2adc-6f36-4c49-9346-b5d1f1672638 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:28.670221 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bd0e3008-415e-404e-9294-7feaaea9d898 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:28.674123 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a6973b74-cbfe-40d9-a9d2-c170f7cf12a7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:28.686757 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-7a2430b4-26c7-409b-bfab-6081cd31bf6a admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=4c33068f9cf14d8f80664e44416331ac&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8466849
Jun 01 10:07:28.688745 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a2430b4-26c7-409b-bfab-6081cd31bf6a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a70f8a05-6490-4b89-91d7-8bea902209ef,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:28.691143 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd0e3008-415e-404e-9294-7feaaea9d898 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef3acf29-a3c1-44d4-a1c8-fa97916f5871,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:28.691437 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7a2430b4-26c7-409b-bfab-6081cd31bf6a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:28.692135 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 59520) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:28.693824 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-bd0e3008-415e-404e-9294-7feaaea9d898 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:28.759724 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bd0e3008-415e-404e-9294-7feaaea9d898 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:28.764092 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-bd0e3008-415e-404e-9294-7feaaea9d898 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/ef3acf29-a3c1-44d4-a1c8-fa97916f5871 HTTP/1.1" status: 204  len: 168 time: 0.4946506
Jun 01 10:07:28.764643 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6e7ea8d6-de4f-4430-b853-fa9b83d92b40 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:28.792310 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6e7ea8d6-de4f-4430-b853-fa9b83d92b40 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:28.956092 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6e7ea8d6-de4f-4430-b853-fa9b83d92b40 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:28.959830 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:28.974068 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e7ea8d6-de4f-4430-b853-fa9b83d92b40 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a70f8a05-6490-4b89-91d7-8bea902209ef,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:28.976284 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6e7ea8d6-de4f-4430-b853-fa9b83d92b40 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:28.982656 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6e7ea8d6-de4f-4430-b853-fa9b83d92b40 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:28.984804 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-6e7ea8d6-de4f-4430-b853-fa9b83d92b40 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/a70f8a05-6490-4b89-91d7-8bea902209ef HTTP/1.1" status: 204  len: 168 time: 0.2900803
Jun 01 10:07:29.088021 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2233128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3139378'] for subnet, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:29.093497 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f6ac4bcf-8e7e-4d3c-98e4-bf08ae2f7ea4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:29.170803 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f2cbb504-b9e2-47fc-88fd-eb43b0f783c6,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:29.171834 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:29.182647 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] Checking segment: {'id': 'a3eadacc-bc0f-438c-ba22-4e06ebfeec11', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '3794c3e5-fe1f-49fc-8746-7fe7f2154093'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92565) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:07:29.183090 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] Network hostable DHCP agents. Network: 3794c3e5-fe1f-49fc-8746-7fe7f2154093, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92565) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:07:29.374758 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] Network 3794c3e5-fe1f-49fc-8746-7fe7f2154093 is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92565) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:07:29.481464 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, 3794c3e5-fe1f-49fc-8746-7fe7f2154093) {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:07:29.490614 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48f7cf5c-1ff3-4430-93a1-6199550b69cb None None] Network 3794c3e5-fe1f-49fc-8746-7fe7f2154093 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:07:29.495270 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:29.496070 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:29.564885 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59542) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:29.585404 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c556da51-5ce4-4bf8-9a52-4f23ee410ad3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:29.602686 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-c556da51-5ce4-4bf8-9a52-4f23ee410ad3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:29.608235 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.2652209
Jun 01 10:07:29.609827 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-c556da51-5ce4-4bf8-9a52-4f23ee410ad3 admin admin] Usage tracker for resource:security_group_rule and tenant:cb17820abc434b48b0770ebc0ba7e82a is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:29.616322 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-c556da51-5ce4-4bf8-9a52-4f23ee410ad3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:29.624118 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-c556da51-5ce4-4bf8-9a52-4f23ee410ad3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:29.718240 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f757ce4-f8e5-4107-91fb-09b88a512f44 req-d3fafb6f-5fb9-40f6-b28e-d69be33b2a03 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:29.720500 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5f757ce4-f8e5-4107-91fb-09b88a512f44 req-d3fafb6f-5fb9-40f6-b28e-d69be33b2a03 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.0956087
Jun 01 10:07:29.744507 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c556da51-5ce4-4bf8-9a52-4f23ee410ad3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:29.751917 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d43754e-0e27-400b-86ed-e28c3bb968f2 None None] Network 3794c3e5-fe1f-49fc-8746-7fe7f2154093 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:07:29.803014 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5f757ce4-f8e5-4107-91fb-09b88a512f44 req-905b94e3-0e57-456c-9f61-670b7f375181 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0585394
Jun 01 10:07:29.819487 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c556da51-5ce4-4bf8-9a52-4f23ee410ad3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:29.828186 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-14719683-3719-4fbc-aa92-87f64e630b07 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:29.896483 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 59552) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:29.919417 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-36255746-64f4-4012-9a77-517b011439fa admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:29.959215 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-36255746-64f4-4012-9a77-517b011439fa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:29.964596 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-36255746-64f4-4012-9a77-517b011439fa admin admin] Usage tracker for resource:security_group_rule and tenant:3c841590a6074b7dabb05ffb1cca947c is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:29.968927 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-36255746-64f4-4012-9a77-517b011439fa admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:29.972602 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-c556da51-5ce4-4bf8-9a52-4f23ee410ad3 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=cb17820abc434b48b0770ebc0ba7e82a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4065461
Jun 01 10:07:29.973555 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c556da51-5ce4-4bf8-9a52-4f23ee410ad3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b583675-288a-4ae9-ab6d-826b49a70b28,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:29.977270 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c556da51-5ce4-4bf8-9a52-4f23ee410ad3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:29.977861 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59558) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:29.984788 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-36255746-64f4-4012-9a77-517b011439fa admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:30.064595 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-551d3aab-7734-488f-8ecd-4662293c23be admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:30.094145 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-551d3aab-7734-488f-8ecd-4662293c23be admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:30.102161 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-36255746-64f4-4012-9a77-517b011439fa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:30.179228 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-36255746-64f4-4012-9a77-517b011439fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:30.188184 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-fb66b956-6c90-49b8-80ba-21f84583b405 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:30.228735 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-36255746-64f4-4012-9a77-517b011439fa admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=3c841590a6074b7dabb05ffb1cca947c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3311620
Jun 01 10:07:30.229476 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36255746-64f4-4012-9a77-517b011439fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bbf97a97-8e5b-4040-bb3b-984cf88c8b91,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:30.231725 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59566) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:30.232320 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-36255746-64f4-4012-9a77-517b011439fa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:30.249875 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-551d3aab-7734-488f-8ecd-4662293c23be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:30.255755 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-0f65d0d5-ccfd-44a9-ada3-cc4f8afbdb4d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:30.279131 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-551d3aab-7734-488f-8ecd-4662293c23be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b583675-288a-4ae9-ab6d-826b49a70b28,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:30.284936 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-551d3aab-7734-488f-8ecd-4662293c23be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:30.294217 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-551d3aab-7734-488f-8ecd-4662293c23be admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:30.296622 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-551d3aab-7734-488f-8ecd-4662293c23be admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/8b583675-288a-4ae9-ab6d-826b49a70b28 HTTP/1.1" status: 204  len: 168 time: 0.3177850
Jun 01 10:07:30.322047 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ec7c879e-9fcf-4edc-b3eb-f684127ff182 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:30.353974 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ec7c879e-9fcf-4edc-b3eb-f684127ff182 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:30.469461 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:07:30.601249 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ec7c879e-9fcf-4edc-b3eb-f684127ff182 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:30.604999 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-dd0bbcb0-dc27-464a-b305-7327860f3250 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:30.618621 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec7c879e-9fcf-4edc-b3eb-f684127ff182 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bbf97a97-8e5b-4040-bb3b-984cf88c8b91,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:30.621474 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-ec7c879e-9fcf-4edc-b3eb-f684127ff182 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:30.623331 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ec7c879e-9fcf-4edc-b3eb-f684127ff182 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:30.624418 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-ec7c879e-9fcf-4edc-b3eb-f684127ff182 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/bbf97a97-8e5b-4040-bb3b-984cf88c8b91 HTTP/1.1" status: 204  len: 168 time: 0.3888574
Jun 01 10:07:31.110125 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377c4eb0-4f9e-4cd6-ab19-6c53c3e58592 req-f2d05686-7a10-4fa4-89df-526c327a862e tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:31.112382 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-377c4eb0-4f9e-4cd6-ab19-6c53c3e58592 req-f2d05686-7a10-4fa4-89df-526c327a862e tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.1695879
Jun 01 10:07:31.199379 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-377c4eb0-4f9e-4cd6-ab19-6c53c3e58592 req-6caccac4-aba6-4be8-8863-cbe76ed80b4a tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0797880
Jun 01 10:07:31.404415 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d1a49f-6b76-463f-9ba2-94439a981a40 req-c26e5254-9638-465e-8d28-4251769c04c1 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:31.405860 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d7d1a49f-6b76-463f-9ba2-94439a981a40 req-c26e5254-9638-465e-8d28-4251769c04c1 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.0914364
Jun 01 10:07:31.456457 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d7d1a49f-6b76-463f-9ba2-94439a981a40 req-7decba49-c842-4e53-886b-35e656d58504 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435190
Jun 01 10:07:32.944388 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-e9943c7b-79b1-475d-8fed-accf500d82a1 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:32.945281 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-e9943c7b-79b1-475d-8fed-accf500d82a1 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Synchronizing usage tracker for tenant:bf05ff611bcf4202aee423d3ef734d15 on resource:network {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:07:33.104623 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-e9943c7b-79b1-475d-8fed-accf500d82a1 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Unset dirty status for tenant:bf05ff611bcf4202aee423d3ef734d15 on resource:network {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:07:33.105898 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-e9943c7b-79b1-475d-8fed-accf500d82a1 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/networks?id=3794c3e5-fe1f-49fc-8746-7fe7f2154093 HTTP/1.1" status: 200  len: 809 time: 0.3782206
Jun 01 10:07:33.121237 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-8e074c0f-f079-4e57-9ce3-ee0d2fc609ea tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/quotas/bf05ff611bcf4202aee423d3ef734d15 HTTP/1.1" status: 200  len: 375 time: 0.0099552
Jun 01 10:07:33.182547 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-edd69a0b-14f7-47aa-af02-8c4ff2096fa3 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=bf05ff611bcf4202aee423d3ef734d15&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0559130
Jun 01 10:07:33.391828 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-04b38929-1acf-4bb4-a48d-0853f4301c04 service neutron] 10.222.0.68 "GET /v2.0/networks/3794c3e5-fe1f-49fc-8746-7fe7f2154093?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2018926
Jun 01 10:07:33.532721 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-bdb04678-d4a3-4463-b47c-349bcc6eca09 service neutron] 10.222.0.68 "GET /v2.0/networks/3794c3e5-fe1f-49fc-8746-7fe7f2154093?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1319399
Jun 01 10:07:33.833765 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5386abde-cddd-4054-8cd4-99e4124c3bec req-d6b879c9-0664-4175-8c83-271db2fcc6bf tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 210 time: 0.0535219
Jun 01 10:07:34.501953 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddc513c2-8325-46d7-b956-ac6de76afea0 req-b7747ec8-81a9-4797-98c2-b5e2e5fd9346 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:34.503365 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddc513c2-8325-46d7-b956-ac6de76afea0 req-b7747ec8-81a9-4797-98c2-b5e2e5fd9346 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1534061
Jun 01 10:07:34.505147 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-911ece00-c7bb-46bd-8890-74cb91cc0169 req-dcc012fa-eec8-46bb-84f5-3268c8b886f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:34.506459 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-911ece00-c7bb-46bd-8890-74cb91cc0169 req-dcc012fa-eec8-46bb-84f5-3268c8b886f9 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=ef4bc75ba53a44cca2e4b7c2b8aeb818&device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 1098 time: 0.1167641
Jun 01 10:07:34.623869 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddc513c2-8325-46d7-b956-ac6de76afea0 req-93f88fb0-a541-4a2d-95ed-f1001f121aab tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1135232
Jun 01 10:07:34.700555 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-911ece00-c7bb-46bd-8890-74cb91cc0169 req-9fef34b8-18d0-4899-82e5-a12700cd978d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:34.702011 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-911ece00-c7bb-46bd-8890-74cb91cc0169 req-9fef34b8-18d0-4899-82e5-a12700cd978d service neutron] 10.222.0.30 "GET /v2.0/networks?id=34268ce8-8baf-41d5-acbc-1b6c167dd481 HTTP/1.1" status: 200  len: 920 time: 0.1760895
Jun 01 10:07:34.789205 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-911ece00-c7bb-46bd-8890-74cb91cc0169 req-0c8bba3b-598e-42ad-8ba7-359f629ea908 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=18b5c352-ee0c-425b-a1bf-666d362844b9 HTTP/1.1" status: 200  len: 217 time: 0.0782044
Jun 01 10:07:34.857808 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-911ece00-c7bb-46bd-8890-74cb91cc0169 req-42c2e9cc-0d9d-4ecf-bd4a-5942fbda6e64 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:34.859292 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-911ece00-c7bb-46bd-8890-74cb91cc0169 req-42c2e9cc-0d9d-4ecf-bd4a-5942fbda6e64 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2ee54c26-f286-4f9a-b791-24aa84feb26a HTTP/1.1" status: 200  len: 859 time: 0.0591667
Jun 01 10:07:34.942821 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-911ece00-c7bb-46bd-8890-74cb91cc0169 req-6fd59312-2415-46e4-9a23-2957ffd9effc service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=34268ce8-8baf-41d5-acbc-1b6c167dd481&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0718284
Jun 01 10:07:34.972018 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7eb44443-7eb4-4df0-acb3-0b8430ef23e9 req-33fac5b4-0781-44c7-8454-7d52d80f33b6 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 210 time: 0.0648904
Jun 01 10:07:35.090289 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-911ece00-c7bb-46bd-8890-74cb91cc0169 req-1bedf4ee-d5b3-474b-858b-97ad72314575 service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1369672
Jun 01 10:07:35.236016 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-911ece00-c7bb-46bd-8890-74cb91cc0169 req-09048543-bea7-4f90-864d-e408fab487fe service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1368423
Jun 01 10:07:35.830523 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2913ebeb-7a2c-4411-ac4f-b6746ad4461a req-199f4401-4fd6-4204-a76f-cc0055c6c13b tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:35.832301 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2913ebeb-7a2c-4411-ac4f-b6746ad4461a req-199f4401-4fd6-4204-a76f-cc0055c6c13b tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.0919514
Jun 01 10:07:35.891579 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2913ebeb-7a2c-4411-ac4f-b6746ad4461a req-2510aa90-bc66-4b33-b08c-2328b36fce33 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0529768
Jun 01 10:07:36.145966 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-543f8665-d23c-4d56-96e3-1c58f9accef6 req-c591c83b-816f-47d8-a378-2fb40eb6ff17 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 210 time: 0.0644729
Jun 01 10:07:36.147745 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59782) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:36.207834 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_v2 [None req-91c68965-0f88-4f6f-9faf-84bd45789c5b admin admin] Deleting subnet 42edf4bd-9e0a-4c38-a416-29405b88fab2 {{(pid=92565) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 10:07:36.210819 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-91c68965-0f88-4f6f-9faf-84bd45789c5b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:36.265400 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-91c68965-0f88-4f6f-9faf-84bd45789c5b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2998467'] for subnet, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:36.322954 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-91c68965-0f88-4f6f-9faf-84bd45789c5b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7791835'] for subnet, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:36.645532 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-91c68965-0f88-4f6f-9faf-84bd45789c5b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7793006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2233195', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3139387'] for subnet, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:36.649511 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-3541d8ac-5198-4071-acaf-1e9a1563af53 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:36.684322 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91c68965-0f88-4f6f-9faf-84bd45789c5b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=42edf4bd-9e0a-4c38-a416-29405b88fab2,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:36.687340 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-91c68965-0f88-4f6f-9faf-84bd45789c5b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:36.688305 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-91c68965-0f88-4f6f-9faf-84bd45789c5b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:36.693969 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-91c68965-0f88-4f6f-9faf-84bd45789c5b admin admin] 10.222.0.68 "DELETE /v2.0/subnets/42edf4bd-9e0a-4c38-a416-29405b88fab2 HTTP/1.1" status: 204  len: 168 time: 0.5450599
Jun 01 10:07:36.696431 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59788) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:36.800484 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5aedd9dd-f0b6-4560-9de1-41e0d3c52f05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7813807'] for network, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:36.930737 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5aedd9dd-f0b6-4560-9de1-41e0d3c52f05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7795028', 'neutron.services.segments.db._delete_segments_for_network-8726958294492'] for network, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:36.937468 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-5aedd9dd-f0b6-4560-9de1-41e0d3c52f05 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7efe7109a340>,) {'filters': {'network_id': ['07fdf8d3-44fa-4947-b167-16794fbf5df9']}} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:07:36.949728 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-5aedd9dd-f0b6-4560-9de1-41e0d3c52f05 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7efe7109a340>, '718f4e32-457c-4c85-a7dd-a74950675598') {'for_net_delete': True} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:07:36.950022 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-5aedd9dd-f0b6-4560-9de1-41e0d3c52f05 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7efe7109a340>, '718f4e32-457c-4c85-a7dd-a74950675598') {} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:07:36.961843 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5aedd9dd-f0b6-4560-9de1-41e0d3c52f05 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726958303133', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2998472'] for segment, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:36.978882 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5aedd9dd-f0b6-4560-9de1-41e0d3c52f05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:36.984876 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5aedd9dd-f0b6-4560-9de1-41e0d3c52f05 admin admin] Releasing vlan 890 on physical network physnet1 to pool {{(pid=92565) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 10:07:36.985254 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5aedd9dd-f0b6-4560-9de1-41e0d3c52f05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2295757'] for segment, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]: Traceback (most recent call last):
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:     timer()
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:     cb(*args, **kw)
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:     return func(*args, **kwargs)
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:     self._notify()
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:     self.callback(batched_events)
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:     event.method(event)
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:     return f(self, *a, **k)
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._get(url).json()
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self.request(url, 'GET', **kwargs)
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 10:07:36.998255 dv-cinder-787262-4-iscsi neutron-server[92565]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 10:07:37.138613 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5aedd9dd-f0b6-4560-9de1-41e0d3c52f05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7795037', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-403638'] for network, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:37.144962 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:37.177291 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5aedd9dd-f0b6-4560-9de1-41e0d3c52f05 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:37.181362 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aedd9dd-f0b6-4560-9de1-41e0d3c52f05 admin admin] Pushing event deleted for resources: {'Network': ['ID=07fdf8d3-44fa-4947-b167-16794fbf5df9,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:37.188944 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-5aedd9dd-f0b6-4560-9de1-41e0d3c52f05 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:37.191468 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-5aedd9dd-f0b6-4560-9de1-41e0d3c52f05 admin admin] 10.222.0.68 "DELETE /v2.0/networks/07fdf8d3-44fa-4947-b167-16794fbf5df9 HTTP/1.1" status: 204  len: 168 time: 0.4938428
Jun 01 10:07:37.194621 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59802) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:37.257288 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_v2 [None req-a134a940-b7a9-4938-b2b2-916da5a67b35 admin admin] Deleting subnet 9a42bfb0-36ef-41e8-9b6b-0e2d90b97341 {{(pid=92565) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 10:07:37.260483 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a134a940-b7a9-4938-b2b2-916da5a67b35 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:37.309684 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a134a940-b7a9-4938-b2b2-916da5a67b35 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2998467'] for subnet, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:37.364228 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a134a940-b7a9-4938-b2b2-916da5a67b35 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7791835'] for subnet, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:37.687274 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a134a940-b7a9-4938-b2b2-916da5a67b35 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7793006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2233195', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3139387'] for subnet, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:37.691258 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:37.726227 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a134a940-b7a9-4938-b2b2-916da5a67b35 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9a42bfb0-36ef-41e8-9b6b-0e2d90b97341,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:37.730047 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a134a940-b7a9-4938-b2b2-916da5a67b35 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:37.733869 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a134a940-b7a9-4938-b2b2-916da5a67b35 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:37.740143 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-a134a940-b7a9-4938-b2b2-916da5a67b35 admin admin] 10.222.0.68 "DELETE /v2.0/subnets/9a42bfb0-36ef-41e8-9b6b-0e2d90b97341 HTTP/1.1" status: 204  len: 168 time: 0.5444551
Jun 01 10:07:37.742816 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 59808) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:37.919719 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-be2839f2-674b-4811-80c0-3ca51d6e7d31 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7813807'] for network, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:38.051487 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-be2839f2-674b-4811-80c0-3ca51d6e7d31 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7795028', 'neutron.services.segments.db._delete_segments_for_network-8726958294492'] for network, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:38.067667 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-be2839f2-674b-4811-80c0-3ca51d6e7d31 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7efe7132c3a0>,) {'filters': {'network_id': ['391b86e7-8349-4b96-9a66-5e39bdeadc63']}} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:07:38.079305 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-be2839f2-674b-4811-80c0-3ca51d6e7d31 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7efe7132c3a0>, 'b3d6a80a-0aba-48ca-b258-b98284b9fa94') {'for_net_delete': True} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:07:38.079596 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-be2839f2-674b-4811-80c0-3ca51d6e7d31 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7efe7132c3a0>, 'b3d6a80a-0aba-48ca-b258-b98284b9fa94') {} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:07:38.090393 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-be2839f2-674b-4811-80c0-3ca51d6e7d31 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726958303133', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2998472'] for segment, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:38.106098 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-be2839f2-674b-4811-80c0-3ca51d6e7d31 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:38.111840 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-be2839f2-674b-4811-80c0-3ca51d6e7d31 admin admin] Releasing vlan 858 on physical network physnet1 to pool {{(pid=92565) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 10:07:38.112210 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-be2839f2-674b-4811-80c0-3ca51d6e7d31 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2295757'] for segment, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]: Traceback (most recent call last):
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:     timer()
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:     cb(*args, **kw)
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:     return func(*args, **kwargs)
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:     self._notify()
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:     self.callback(batched_events)
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:     event.method(event)
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:     return f(self, *a, **k)
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._get(url).json()
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self.request(url, 'GET', **kwargs)
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 10:07:38.125723 dv-cinder-787262-4-iscsi neutron-server[92565]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 10:07:38.251472 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-be2839f2-674b-4811-80c0-3ca51d6e7d31 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7795037', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-403638'] for network, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:38.256535 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-be2839f2-674b-4811-80c0-3ca51d6e7d31 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:38.260525 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:38.287394 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be2839f2-674b-4811-80c0-3ca51d6e7d31 admin admin] Pushing event deleted for resources: {'Network': ['ID=391b86e7-8349-4b96-9a66-5e39bdeadc63,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:38.289689 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-be2839f2-674b-4811-80c0-3ca51d6e7d31 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:38.295335 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-be2839f2-674b-4811-80c0-3ca51d6e7d31 admin admin] 10.222.0.68 "DELETE /v2.0/networks/391b86e7-8349-4b96-9a66-5e39bdeadc63 HTTP/1.1" status: 204  len: 168 time: 0.5480850
Jun 01 10:07:38.473007 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-def7b5c9-5659-472b-87d4-bce5a707684b req-7b6d6675-a69b-4098-a458-10adc86923f8 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 210 time: 0.0577209
Jun 01 10:07:38.500036 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68b4334d-7a37-4a3f-b1af-29c41f2092e3 req-e2f1bbf2-21cc-4202-be70-904a655082c8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:38.501464 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-68b4334d-7a37-4a3f-b1af-29c41f2092e3 req-e2f1bbf2-21cc-4202-be70-904a655082c8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1231680
Jun 01 10:07:38.548228 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-68b4334d-7a37-4a3f-b1af-29c41f2092e3 req-65bfe1f1-60e7-4dcc-9879-9af877b98b86 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411253
Jun 01 10:07:38.766681 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 59826) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:38.815097 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-49cf0077-a596-4212-bd87-851b198427b4 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=4dfe4071c865475da8fdf2fb00d78d1a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0471077
Jun 01 10:07:38.820000 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 59830) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:38.882610 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-30158014-0b1d-4f24-85bd-f9ba0301d1fb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:38.908102 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-30158014-0b1d-4f24-85bd-f9ba0301d1fb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:39.053408 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-30158014-0b1d-4f24-85bd-f9ba0301d1fb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:39.065578 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7a2430b4-26c7-409b-bfab-6081cd31bf6a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:39.078815 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30158014-0b1d-4f24-85bd-f9ba0301d1fb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=684cd0af-0564-4ce2-807a-5fd1f5b4bbdd,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:39.081611 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-30158014-0b1d-4f24-85bd-f9ba0301d1fb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:39.089641 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-30158014-0b1d-4f24-85bd-f9ba0301d1fb admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:39.093003 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-30158014-0b1d-4f24-85bd-f9ba0301d1fb admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/684cd0af-0564-4ce2-807a-5fd1f5b4bbdd HTTP/1.1" status: 204  len: 168 time: 0.2698681
Jun 01 10:07:39.614704 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-a350b256-ce28-4f08-9eb7-4816f68aee80 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:39.616672 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-a350b256-ce28-4f08-9eb7-4816f68aee80 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.30 "GET /v2.0/networks?id=3794c3e5-fe1f-49fc-8746-7fe7f2154093 HTTP/1.1" status: 200  len: 809 time: 0.3193851
Jun 01 10:07:39.683828 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Request body: {'port': {'device_id': '759e40d4-f862-43a6-af5f-c75d3f29c250', 'network_id': '3794c3e5-fe1f-49fc-8746-7fe7f2154093', 'admin_state_up': True, 'tenant_id': 'bf05ff611bcf4202aee423d3ef734d15'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:07:39.776458 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4dc7627e-86f4-4341-92ee-f6603290c3f9 req-b2871aea-9809-418a-8a1f-f47e7a8b4c08 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 210 time: 0.1522341
Jun 01 10:07:39.920754 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d30d15c-704e-45f9-b0b0-04d40fd633d2 req-e1cd96ef-6ec8-46d8-b3fe-9aa335cad8bb tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:39.922492 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5d30d15c-704e-45f9-b0b0-04d40fd633d2 req-e1cd96ef-6ec8-46d8-b3fe-9aa335cad8bb tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.2191002
Jun 01 10:07:39.923608 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:39.928504 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Usage tracker for resource:port and tenant:bf05ff611bcf4202aee423d3ef734d15 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:39.933332 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:39.952616 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:39.983104 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5d30d15c-704e-45f9-b0b0-04d40fd633d2 req-5d8f1329-789c-49f7-b35d-1c7aedc7b939 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0514593
Jun 01 10:07:40.006764 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 59864) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:40.049444 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Made reservation on behalf of bf05ff611bcf4202aee423d3ef734d15 for: {'port': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:07:40.053433 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:40.075676 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-e3123b5e-7a7c-4d74-bac9-50b6ca1bc84c admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=9aa6eb3213e94c79932591b17a24f1e6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0685003
Jun 01 10:07:40.078178 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 59868) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:40.247361 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5dafba26-ff92-44b5-b965-d59a186334ae admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:40.292381 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5dafba26-ff92-44b5-b965-d59a186334ae admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:40.304251 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Allocated IP 172.20.0.9 (3794c3e5-fe1f-49fc-8746-7fe7f2154093/f2cbb504-b9e2-47fc-88fd-eb43b0f783c6/5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:07:40.468194 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5dafba26-ff92-44b5-b965-d59a186334ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:40.477317 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:40.486966 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-1561d930-7fd5-4b32-b3d8-bc88150095d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:40.541639 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dafba26-ff92-44b5-b965-d59a186334ae admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bff6ae57-bbd3-4390-8a28-780205558511,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:40.548829 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-5dafba26-ff92-44b5-b965-d59a186334ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:40.564662 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5dafba26-ff92-44b5-b965-d59a186334ae admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:40.565745 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-5dafba26-ff92-44b5-b965-d59a186334ae admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/bff6ae57-bbd3-4390-8a28-780205558511 HTTP/1.1" status: 204  len: 168 time: 0.4867821
Jun 01 10:07:40.637612 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:40.779022 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:40.786937 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f315ac5a-f856-441a-83f3-78864d15e316 tempest-DeleteServersTestJSON-693922128 tempest-DeleteServersTestJSON-693922128-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:40.861015 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Network 3794c3e5-fe1f-49fc-8746-7fe7f2154093 is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:07:40.864369 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:07:40.868317 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:07:40.873626 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:40.882098 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:40.892936 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Pushing event updated for resources: {'Port': ['ID=5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:40.896782 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:41.007733 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.3471088
Jun 01 10:07:42.949590 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-900cf6f1-6676-4376-9478-f69af8204e77 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:43.182580 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Request body: {'port': {'device_id': '759e40d4-f862-43a6-af5f-c75d3f29c250', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:07:43.230731 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:43.303367 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:43.572567 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc0e2f99-9255-4a99-b025-3e829a839537 req-f22eaf33-fa4c-4507-97c7-b0f90208b455 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:43.573260 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-cc0e2f99-9255-4a99-b025-3e829a839537 req-f22eaf33-fa4c-4507-97c7-b0f90208b455 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Synchronizing usage tracker for tenant:bf05ff611bcf4202aee423d3ef734d15 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:07:43.586072 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3d8a13b-5ee4-4131-855a-3eedd7e4ec94 req-a83557ef-7887-4647-af68-43293365c641 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:43.587530 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b3d8a13b-5ee4-4131-855a-3eedd7e4ec94 req-a83557ef-7887-4647-af68-43293365c641 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.2752659
Jun 01 10:07:43.706223 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-cc0e2f99-9255-4a99-b025-3e829a839537 req-f22eaf33-fa4c-4507-97c7-b0f90208b455 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Unset dirty status for tenant:bf05ff611bcf4202aee423d3ef734d15 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:07:43.707280 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cc0e2f99-9255-4a99-b025-3e829a839537 req-f22eaf33-fa4c-4507-97c7-b0f90208b455 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 931 time: 0.3939116
Jun 01 10:07:43.738594 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b3d8a13b-5ee4-4131-855a-3eedd7e4ec94 req-7b523f6d-ae3f-4fa7-a79f-0f9305c16bfa tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1308184
Jun 01 10:07:43.792525 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-cc0e2f99-9255-4a99-b025-3e829a839537 req-fd28351e-8fb3-4012-9c7a-6a0691853b17 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Synchronizing usage tracker for tenant:bf05ff611bcf4202aee423d3ef734d15 on resource:security_group {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:07:43.881658 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 {{(pid=92566) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:07:43.889372 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:43.904981 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Transition to ACTIVE for port object 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 will not be triggered until provisioned by entity L2. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:07:43.907496 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-cc0e2f99-9255-4a99-b025-3e829a839537 req-fd28351e-8fb3-4012-9c7a-6a0691853b17 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Unset dirty status for tenant:bf05ff611bcf4202aee423d3ef734d15 on resource:security_group {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:07:43.912148 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cc0e2f99-9255-4a99-b025-3e829a839537 req-fd28351e-8fb3-4012-9c7a-6a0691853b17 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1945555
Jun 01 10:07:43.967142 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:43.972303 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:43.999280 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:44.220766 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Pushing event updated for resources: {'Port': ['ID=5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:44.224054 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.252s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:44.249448 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Attempting to bind port 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:07:44.249993 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Attempting to bind port 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': 'a3eadacc-bc0f-438c-ba22-4e06ebfeec11', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '3794c3e5-fe1f-49fc-8746-7fe7f2154093'}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:07:44.250347 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Attempting to bind port 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 on network 3794c3e5-fe1f-49fc-8746-7fe7f2154093 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:07:44.256734 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Port 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 on network 3794c3e5-fe1f-49fc-8746-7fe7f2154093 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:07:44.257067 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Attempting to bind port 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 on network 3794c3e5-fe1f-49fc-8746-7fe7f2154093 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:07:44.264828 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 7, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:07:44.265174 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Checking segment: {'id': 'a3eadacc-bc0f-438c-ba22-4e06ebfeec11', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '3794c3e5-fe1f-49fc-8746-7fe7f2154093'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:07:44.265561 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Bound using segment: {'id': 'a3eadacc-bc0f-438c-ba22-4e06ebfeec11', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '3794c3e5-fe1f-49fc-8746-7fe7f2154093'} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:07:44.265994 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Bound port: 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a3eadacc-bc0f-438c-ba22-4e06ebfeec11', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '3794c3e5-fe1f-49fc-8746-7fe7f2154093'}}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:07:44.266349 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:44.370579 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] For port 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8, host hv-cinder-78726, cleared binding levels {{(pid=92566) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:07:44.373521 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] For port 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8,segment=NetworkSegment(a3eadacc-bc0f-438c-ba22-4e06ebfeec11),segment_id=a3eadacc-bc0f-438c-ba22-4e06ebfeec11)] {{(pid=92566) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:07:44.435970 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:44.440264 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:44.498981 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:44.499592 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:44.501036 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] 10.222.0.30 "PUT /v2.0/ports/5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 HTTP/1.1" status: 200  len: 1093 time: 1.3230126
Jun 01 10:07:44.501514 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '759e40d4-f862-43a6-af5f-c75d3f29c250', 'tag': '5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:07:44.503790 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d4ebd48-14a6-4bee-80a3-7e321767f228" -d '{"events": [{"name": "network-changed", "server_uuid": "759e40d4-f862-43a6-af5f-c75d3f29c250", "tag": "5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:07:44.519824 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Pushing event updated for resources: {'Port': ['ID=5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8,revision_number=3']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:44.523332 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:45.744383 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:46.730582 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:07:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a971748c-16d3-4712-aa78-ec0531c7467e x-openstack-request-id: req-a971748c-16d3-4712-aa78-ec0531c7467e {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:07:46.736330 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "759e40d4-f862-43a6-af5f-c75d3f29c250", "tag": "5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:07:46.736330 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-a971748c-16d3-4712-aa78-ec0531c7467e {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:07:46.736330 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '759e40d4-f862-43a6-af5f-c75d3f29c250', 'tag': '5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8', 'status': 'completed', 'code': 200}
Jun 01 10:07:46.977376 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d4ebd48-14a6-4bee-80a3-7e321767f228 req-c923e21b-703f-4603-843e-983f9f17932e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:46.978841 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6d4ebd48-14a6-4bee-80a3-7e321767f228 req-c923e21b-703f-4603-843e-983f9f17932e service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=bf05ff611bcf4202aee423d3ef734d15&device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 1096 time: 0.2133892
Jun 01 10:07:46.987305 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ae0cfd7-3d69-4874-940c-948674728371 req-dc5bf8ac-f1cb-4eb6-a4fb-c3c09a92685d tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:46.988893 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3ae0cfd7-3d69-4874-940c-948674728371 req-dc5bf8ac-f1cb-4eb6-a4fb-c3c09a92685d tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1805520
Jun 01 10:07:47.021273 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f02f60c-eadd-4eb6-9c92-86cd2e71ec2f req-be33c70a-ea88-4d26-a227-51a3b6971546 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:47.022729 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0f02f60c-eadd-4eb6-9c92-86cd2e71ec2f req-be33c70a-ea88-4d26-a227-51a3b6971546 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 943 time: 0.1748738
Jun 01 10:07:47.167319 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3ae0cfd7-3d69-4874-940c-948674728371 req-50565aec-a971-4770-80fe-5a0cc1dec093 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1569843
Jun 01 10:07:47.181320 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0f02f60c-eadd-4eb6-9c92-86cd2e71ec2f req-75355baa-4c28-463b-a32b-7ada25ae27ae tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1432903
Jun 01 10:07:47.211007 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d4ebd48-14a6-4bee-80a3-7e321767f228 req-2800c475-66aa-4779-b620-de6618ca9343 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:47.212507 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6d4ebd48-14a6-4bee-80a3-7e321767f228 req-2800c475-66aa-4779-b620-de6618ca9343 service neutron] 10.222.0.30 "GET /v2.0/networks?tenant_id=bf05ff611bcf4202aee423d3ef734d15&shared=False HTTP/1.1" status: 200  len: 910 time: 0.2227905
Jun 01 10:07:48.273372 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d4ebd48-14a6-4bee-80a3-7e321767f228 req-e744ff9f-dcfc-40d6-ba59-40aab48304a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:48.275000 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6d4ebd48-14a6-4bee-80a3-7e321767f228 req-e744ff9f-dcfc-40d6-ba59-40aab48304a1 service neutron] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1348882
Jun 01 10:07:50.302020 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-359f4320-6d5d-4740-95c2-2f0d3a46ba79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:50.304177 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-359f4320-6d5d-4740-95c2-2f0d3a46ba79 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=bf05ff611bcf4202aee423d3ef734d15&device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 1096 time: 0.1441350
Jun 01 10:07:50.415603 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-65830da7-8ee8-4b62-a06d-973207ab161f service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 HTTP/1.1" status: 200  len: 217 time: 0.0752938
Jun 01 10:07:50.424681 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc70ed62-fb7e-4423-bdac-dc993a0fcff5 req-de5743bb-f16e-4ddc-9d1c-2e5a4b8e1d36 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:50.426083 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fc70ed62-fb7e-4423-bdac-dc993a0fcff5 req-de5743bb-f16e-4ddc-9d1c-2e5a4b8e1d36 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.2102709
Jun 01 10:07:50.525068 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-14568497-09fe-4a9a-a20f-f728f48ad3f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:50.526375 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-14568497-09fe-4a9a-a20f-f728f48ad3f2 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=f2cbb504-b9e2-47fc-88fd-eb43b0f783c6 HTTP/1.1" status: 200  len: 849 time: 0.0994658
Jun 01 10:07:50.540498 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fc70ed62-fb7e-4423-bdac-dc993a0fcff5 req-03344fc5-1618-4c9f-a104-5d5bb5b18d87 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0760415
Jun 01 10:07:50.586760 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74536a16-6eee-466e-939e-80cea108ecd7 req-48eb7d39-4863-413c-89ba-1feb7b7ac6f1 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:50.588283 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-74536a16-6eee-466e-939e-80cea108ecd7 req-48eb7d39-4863-413c-89ba-1feb7b7ac6f1 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 943 time: 0.2831836
Jun 01 10:07:50.595120 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-a1924cf1-b520-4c06-ab91-8074cb48afeb service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=3794c3e5-fe1f-49fc-8746-7fe7f2154093&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0508401
Jun 01 10:07:50.716856 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-74536a16-6eee-466e-939e-80cea108ecd7 req-0a7daa24-4ca0-469f-8bd4-01e15c4c67c5 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1207933
Jun 01 10:07:50.789253 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-57fc2816-a763-40bc-8b5f-d53b76ec8ba8 service neutron] 10.222.0.30 "GET /v2.0/networks/3794c3e5-fe1f-49fc-8746-7fe7f2154093?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1782551
Jun 01 10:07:51.028694 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87019e75-4a39-4b98-bee4-d74f2ac6df61 req-2b21789d-9afa-4d5d-9726-7bdd2dbf2d0c service neutron] 10.222.0.30 "GET /v2.0/networks/3794c3e5-fe1f-49fc-8746-7fe7f2154093?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2311416
Jun 01 10:07:51.544142 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438fe18a-37e9-496d-9f84-20f3600ec3a8 req-4378b803-700e-44fc-be7b-71e5b5adc665 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:51.544740 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-438fe18a-37e9-496d-9f84-20f3600ec3a8 req-4378b803-700e-44fc-be7b-71e5b5adc665 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 1098 time: 0.0733638
Jun 01 10:07:51.589258 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-438fe18a-37e9-496d-9f84-20f3600ec3a8 req-0c26781d-9129-4e0f-92b1-75b576a25fb9 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0355701
Jun 01 10:07:51.733640 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce3dffe-edc1-463c-9447-e3b66276cfd0 req-e689bbee-bf9a-4b3e-9650-9a59b500d4fd tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:51.735140 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3ce3dffe-edc1-463c-9447-e3b66276cfd0 req-e689bbee-bf9a-4b3e-9650-9a59b500d4fd tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.0794744
Jun 01 10:07:51.783876 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3ce3dffe-edc1-463c-9447-e3b66276cfd0 req-c807527a-6a26-4f4b-bc97-d6e005dd82ba tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421212
Jun 01 10:07:51.915439 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-756475d4-6918-4e29-98d4-fd5d95385b5b req-116016d3-1d77-4a38-9b26-2efdf195dba2 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:51.916914 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-756475d4-6918-4e29-98d4-fd5d95385b5b req-116016d3-1d77-4a38-9b26-2efdf195dba2 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 943 time: 0.0818319
Jun 01 10:07:51.961783 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-756475d4-6918-4e29-98d4-fd5d95385b5b req-8983bc24-fa6e-4cfe-bd8c-6c7a7e823449 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391951
Jun 01 10:07:52.381628 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 60128) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:52.508408 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-87cc278a-1e23-47dd-8902-c06d2a4eceb2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:52.523076 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-87cc278a-1e23-47dd-8902-c06d2a4eceb2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:52.527331 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-87cc278a-1e23-47dd-8902-c06d2a4eceb2 admin admin] Usage tracker for resource:security_group_rule and tenant:04833a3d29f74ac4b54ef43c50f7dbe1 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:52.530282 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-87cc278a-1e23-47dd-8902-c06d2a4eceb2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:52.536349 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-87cc278a-1e23-47dd-8902-c06d2a4eceb2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:52.620242 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-87cc278a-1e23-47dd-8902-c06d2a4eceb2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:52.692846 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-87cc278a-1e23-47dd-8902-c06d2a4eceb2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:52.707357 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c556da51-5ce4-4bf8-9a52-4f23ee410ad3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:52.738508 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87cc278a-1e23-47dd-8902-c06d2a4eceb2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c00fa76-c8e7-4948-bf8f-4d072825e681,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:52.748776 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-87cc278a-1e23-47dd-8902-c06d2a4eceb2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:52.762266 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 60146) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:52.762926 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-87cc278a-1e23-47dd-8902-c06d2a4eceb2 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=04833a3d29f74ac4b54ef43c50f7dbe1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3801632
Jun 01 10:07:52.824911 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8bf105b9-6395-45d6-adde-ae900a75e5b3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:52.854052 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8bf105b9-6395-45d6-adde-ae900a75e5b3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:53.004479 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b4a6380-abea-4e42-b823-334cf319a1e5 req-75ad04d8-28e2-4cfa-ad0c-091ffd1f062a tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:53.005780 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3b4a6380-abea-4e42-b823-334cf319a1e5 req-75ad04d8-28e2-4cfa-ad0c-091ffd1f062a tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.0850294
Jun 01 10:07:53.050991 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3b4a6380-abea-4e42-b823-334cf319a1e5 req-850ca3af-ddf3-49aa-9e5e-aa8b355bb157 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392306
Jun 01 10:07:53.069784 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8bf105b9-6395-45d6-adde-ae900a75e5b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:53.074782 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:53.124116 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bf105b9-6395-45d6-adde-ae900a75e5b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c00fa76-c8e7-4948-bf8f-4d072825e681,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:53.138023 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-8bf105b9-6395-45d6-adde-ae900a75e5b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:53.142464 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8bf105b9-6395-45d6-adde-ae900a75e5b3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:53.149976 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-8bf105b9-6395-45d6-adde-ae900a75e5b3 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/5c00fa76-c8e7-4948-bf8f-4d072825e681 HTTP/1.1" status: 204  len: 168 time: 0.3866687
Jun 01 10:07:53.193078 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0fc9252-f38a-4221-9a92-2580387f4dce req-96aef7c7-71c0-49ac-98da-4d2f06cfc2f1 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:53.199667 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c0fc9252-f38a-4221-9a92-2580387f4dce req-96aef7c7-71c0-49ac-98da-4d2f06cfc2f1 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 943 time: 0.1253755
Jun 01 10:07:53.248829 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c0fc9252-f38a-4221-9a92-2580387f4dce req-20f1a77a-8cbb-4a80-a8b5-73fa66bf90c2 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0475531
Jun 01 10:07:53.597904 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:07:53.770306 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8,segment=NetworkSegment(a3eadacc-bc0f-438c-ba22-4e06ebfeec11),segment_id=a3eadacc-bc0f-438c-ba22-4e06ebfeec11)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:07:53.784326 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': '5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8', 'network_id': '3794c3e5-fe1f-49fc-8746-7fe7f2154093', 'port_id': '5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8', 'mac_address': 'fa:16:3e:ea:e0:0e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 884, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f2cbb504-b9e2-47fc-88fd-eb43b0f783c6', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:07:53.832943 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3779850-3691-4bda-944d-51601c2aacee req-1ea3bc2f-a5a8-4947-8cbf-f927dd0390c6 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:53.834465 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c3779850-3691-4bda-944d-51601c2aacee req-1ea3bc2f-a5a8-4947-8cbf-f927dd0390c6 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1466708
Jun 01 10:07:53.839556 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90739dca-5bc0-4e66-8bb0-b265b8cb11a8 req-017657c3-715b-4036-8f66-307afb6496e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:53.839556 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-90739dca-5bc0-4e66-8bb0-b265b8cb11a8 req-017657c3-715b-4036-8f66-307afb6496e4 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=ef4bc75ba53a44cca2e4b7c2b8aeb818&device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 1098 time: 0.1490407
Jun 01 10:07:53.846649 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:53.864146 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:07:53.881320 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8,segment=NetworkSegment(a3eadacc-bc0f-438c-ba22-4e06ebfeec11),segment_id=a3eadacc-bc0f-438c-ba22-4e06ebfeec11)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:07:53.961044 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:53.962830 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:53.970982 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c3779850-3691-4bda-944d-51601c2aacee req-bbfb6439-7be3-4fcd-90a2-d29a548b8c9f tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1302392
Jun 01 10:07:54.027217 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90739dca-5bc0-4e66-8bb0-b265b8cb11a8 req-0df31d7e-40e3-42eb-95f6-f59a442175c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:54.028761 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-90739dca-5bc0-4e66-8bb0-b265b8cb11a8 req-0df31d7e-40e3-42eb-95f6-f59a442175c7 service neutron] 10.222.0.30 "GET /v2.0/networks?id=34268ce8-8baf-41d5-acbc-1b6c167dd481 HTTP/1.1" status: 200  len: 920 time: 0.1744595
Jun 01 10:07:54.030312 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:54.038773 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:54.042635 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:54.042635 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:54.042635 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:54.042635 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:54.042635 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:54.042635 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:54.042635 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:54.042635 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:54.042635 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:54.043677 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:54.044165 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:07:54.056000 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:54.111219 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-90739dca-5bc0-4e66-8bb0-b265b8cb11a8 req-d4adfb79-aa0c-4573-8e61-a1cdf2a1f3db service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=18b5c352-ee0c-425b-a1bf-666d362844b9 HTTP/1.1" status: 200  len: 217 time: 0.0752335
Jun 01 10:07:54.189203 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90739dca-5bc0-4e66-8bb0-b265b8cb11a8 req-d9ddd3c5-509e-4023-9a94-85c0a4902d9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:54.190719 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-90739dca-5bc0-4e66-8bb0-b265b8cb11a8 req-d9ddd3c5-509e-4023-9a94-85c0a4902d9a service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2ee54c26-f286-4f9a-b791-24aa84feb26a HTTP/1.1" status: 200  len: 859 time: 0.0623639
Jun 01 10:07:54.242676 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-90739dca-5bc0-4e66-8bb0-b265b8cb11a8 req-6b0b593d-af65-4e18-8998-ee75bf86d744 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=34268ce8-8baf-41d5-acbc-1b6c167dd481&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0432396
Jun 01 10:07:54.267411 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:07:54.398200 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-90739dca-5bc0-4e66-8bb0-b265b8cb11a8 req-8d5d280d-6a35-4175-a023-134f64aedb86 service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1449919
Jun 01 10:07:54.618592 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45eaec67-30dc-494e-b4b7-7777086d4a07 req-c4df3296-cea5-4359-9552-b0890c1817c2 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:54.625402 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-45eaec67-30dc-494e-b4b7-7777086d4a07 req-c4df3296-cea5-4359-9552-b0890c1817c2 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 944 time: 0.2113707
Jun 01 10:07:54.669068 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-90739dca-5bc0-4e66-8bb0-b265b8cb11a8 req-f6ad4cf7-51ff-4879-a029-06569b684e5e service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1931286
Jun 01 10:07:54.697711 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-45eaec67-30dc-494e-b4b7-7777086d4a07 req-970bd0ab-8546-46c2-8b81-0befffc46336 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0709195
Jun 01 10:07:55.181622 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 60234) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:55.248138 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25b38ce9-5c4b-4f82-b038-91be49e42def req-1a04e370-6524-40b6-9c48-f2c9d2322cf4 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:55.252477 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-25b38ce9-5c4b-4f82-b038-91be49e42def req-1a04e370-6524-40b6-9c48-f2c9d2322cf4 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1757321
Jun 01 10:07:55.296435 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-25b38ce9-5c4b-4f82-b038-91be49e42def req-876f6b71-ee80-49f2-8dc6-2617cdda471c tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409162
Jun 01 10:07:55.314248 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b03be602-b662-4f3c-864f-7021354b8399 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:55.329281 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-b03be602-b662-4f3c-864f-7021354b8399 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:55.333160 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-b03be602-b662-4f3c-864f-7021354b8399 admin admin] Usage tracker for resource:security_group_rule and tenant:d999ceaf513642d3976e7e64e998af1b is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:55.336099 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-b03be602-b662-4f3c-864f-7021354b8399 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:55.341663 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-b03be602-b662-4f3c-864f-7021354b8399 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:55.412267 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 60246) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:55.432374 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b03be602-b662-4f3c-864f-7021354b8399 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:55.528223 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1e818cc1-effc-418f-b88f-273266c2838f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:55.543223 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-1e818cc1-effc-418f-b88f-273266c2838f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:55.544629 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b03be602-b662-4f3c-864f-7021354b8399 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:55.547141 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-1e818cc1-effc-418f-b88f-273266c2838f admin admin] Usage tracker for resource:security_group_rule and tenant:f5fad279d87b497a9dcf295b2118987d is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:55.550000 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-1e818cc1-effc-418f-b88f-273266c2838f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:55.554471 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-4eeaf76d-2d5d-4024-98dd-88ada5d63113 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:55.556736 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-1e818cc1-effc-418f-b88f-273266c2838f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:55.597708 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b03be602-b662-4f3c-864f-7021354b8399 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=76508f9c-be29-4318-933b-dea361a65cd0,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:55.611488 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-b03be602-b662-4f3c-864f-7021354b8399 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=d999ceaf513642d3976e7e64e998af1b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4239151
Jun 01 10:07:55.611488 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b03be602-b662-4f3c-864f-7021354b8399 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:55.611488 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 60256) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:55.611983 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:07:55.671372 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1e818cc1-effc-418f-b88f-273266c2838f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:55.687116 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-773296cb-c88c-4893-a361-0c8bd7007eb0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:55.713608 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-773296cb-c88c-4893-a361-0c8bd7007eb0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:55.761327 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1e818cc1-effc-418f-b88f-273266c2838f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:55.777452 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-8bf105b9-6395-45d6-adde-ae900a75e5b3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:55.789558 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:07:55.795758 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:07:55.798418 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:55.881590 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-773296cb-c88c-4893-a361-0c8bd7007eb0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:55.882249 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-1e818cc1-effc-418f-b88f-273266c2838f admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=f5fad279d87b497a9dcf295b2118987d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4688659
Jun 01 10:07:55.890149 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 60270) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:55.891114 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-87cc278a-1e23-47dd-8902-c06d2a4eceb2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:55.909438 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e818cc1-effc-418f-b88f-273266c2838f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c1f76385-ca68-4167-a3fb-d4cc2d4c91a7,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:55.914516 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1e818cc1-effc-418f-b88f-273266c2838f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:55.930856 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:55.939747 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-611e9077-a710-42f5-a65a-049b904ac6c2 req-f67eeca6-64b8-4cf8-a943-a46b1ee77b1b tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:55.941581 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-611e9077-a710-42f5-a65a-049b904ac6c2 req-f67eeca6-64b8-4cf8-a943-a46b1ee77b1b tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 944 time: 0.1249719
Jun 01 10:07:55.948635 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-773296cb-c88c-4893-a361-0c8bd7007eb0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=76508f9c-be29-4318-933b-dea361a65cd0,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:55.957557 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-773296cb-c88c-4893-a361-0c8bd7007eb0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:55.975253 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-773296cb-c88c-4893-a361-0c8bd7007eb0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:55.980178 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-773296cb-c88c-4893-a361-0c8bd7007eb0 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/76508f9c-be29-4318-933b-dea361a65cd0 HTTP/1.1" status: 204  len: 168 time: 0.3703246
Jun 01 10:07:55.981769 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '759e40d4-f862-43a6-af5f-c75d3f29c250', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:07:55.985094 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f5ea5b59-036c-4ce2-9206-82ff46fa31f8" -d '{"events": [{"server_uuid": "759e40d4-f862-43a6-af5f-c75d3f29c250", "name": "network-vif-plugged", "status": "completed", "tag": "5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:07:55.997740 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8,segment=NetworkSegment(a3eadacc-bc0f-438c-ba22-4e06ebfeec11),segment_id=a3eadacc-bc0f-438c-ba22-4e06ebfeec11)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:07:56.023922 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-611e9077-a710-42f5-a65a-049b904ac6c2 req-7f9a5242-9436-49b0-abca-6ee0807a7ae7 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0715079
Jun 01 10:07:56.030109 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8bf78487-537e-4f7f-bd2f-db6baae279c8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:56.081286 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:56.086510 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:07:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-725b583b-c783-4f31-b466-e788ec8c6649 x-openstack-request-id: req-725b583b-c783-4f31-b466-e788ec8c6649 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:07:56.086806 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "759e40d4-f862-43a6-af5f-c75d3f29c250", "name": "network-vif-plugged", "status": "completed", "tag": "5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:07:56.091327 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-725b583b-c783-4f31-b466-e788ec8c6649 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:07:56.091327 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '759e40d4-f862-43a6-af5f-c75d3f29c250', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8', 'code': 200}
Jun 01 10:07:56.091327 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:56.097090 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8bf78487-537e-4f7f-bd2f-db6baae279c8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:56.145898 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:56.172121 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:56.175176 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:56.246931 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8bf78487-537e-4f7f-bd2f-db6baae279c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:56.252154 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-ec7c879e-9fcf-4edc-b3eb-f684127ff182 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:56.264298 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bf78487-537e-4f7f-bd2f-db6baae279c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c1f76385-ca68-4167-a3fb-d4cc2d4c91a7,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:56.268099 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8bf78487-537e-4f7f-bd2f-db6baae279c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:56.270066 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8bf78487-537e-4f7f-bd2f-db6baae279c8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:56.271468 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-8bf78487-537e-4f7f-bd2f-db6baae279c8 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/c1f76385-ca68-4167-a3fb-d4cc2d4c91a7 HTTP/1.1" status: 204  len: 168 time: 0.3629010
Jun 01 10:07:56.563111 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7a2f963-3e71-498e-b72e-912d95b11753 req-95c9ce0d-bcb2-4b3b-9426-2eebb7aacafd tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:56.564644 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b7a2f963-3e71-498e-b72e-912d95b11753 req-95c9ce0d-bcb2-4b3b-9426-2eebb7aacafd tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1472208
Jun 01 10:07:56.570922 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5049b31-221e-4031-8501-65111dd6bb96 req-80772df6-011d-4fed-976b-93968fd8cdda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:56.572545 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e5049b31-221e-4031-8501-65111dd6bb96 req-80772df6-011d-4fed-976b-93968fd8cdda service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 1098 time: 0.1167395
Jun 01 10:07:56.640206 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b7a2f963-3e71-498e-b72e-912d95b11753 req-a1c5f163-0273-4814-a25d-0398c56af7c3 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0667140
Jun 01 10:07:56.652773 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e5049b31-221e-4031-8501-65111dd6bb96 req-29333c26-f866-46b4-a5c5-8592d47aec5a service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0642428
Jun 01 10:07:57.083110 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 60312) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:57.117312 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7cd5261b-5b53-4509-809c-34ec65a33242 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:57.196126 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-7cd5261b-5b53-4509-809c-34ec65a33242 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:57.201886 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-7cd5261b-5b53-4509-809c-34ec65a33242 admin admin] Usage tracker for resource:security_group_rule and tenant:a2fc8a1d6b3644a6afeadd9e0c8cfb7e is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:57.205492 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-7cd5261b-5b53-4509-809c-34ec65a33242 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:57.218104 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-7cd5261b-5b53-4509-809c-34ec65a33242 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:57.268077 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc5f179-4c8c-4e82-8726-e5ae0563be92 req-288cd8ac-d415-4245-8cb8-5dfb162c5784 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:57.269528 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4cc5f179-4c8c-4e82-8726-e5ae0563be92 req-288cd8ac-d415-4245-8cb8-5dfb162c5784 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 945 time: 0.1292934
Jun 01 10:07:57.337374 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4cc5f179-4c8c-4e82-8726-e5ae0563be92 req-faf9ca2f-8c7d-401a-a09e-3a603db46318 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0591278
Jun 01 10:07:57.369300 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7cd5261b-5b53-4509-809c-34ec65a33242 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:57.416251 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 60320) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:57.452818 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7cd5261b-5b53-4509-809c-34ec65a33242 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:57.475118 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-fb76229d-42c9-4220-9ce0-6b687374745c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:57.514591 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cd5261b-5b53-4509-809c-34ec65a33242 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=73988b87-5aeb-46e2-9da1-9dab0c5b5421,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:57.532854 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-7cd5261b-5b53-4509-809c-34ec65a33242 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=a2fc8a1d6b3644a6afeadd9e0c8cfb7e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4453976
Jun 01 10:07:57.532854 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7cd5261b-5b53-4509-809c-34ec65a33242 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:57.533337 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 60330) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:57.549181 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a1808e8c-ea4c-4f77-b4f3-b8613c9792cd admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:57.564994 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-a1808e8c-ea4c-4f77-b4f3-b8613c9792cd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:57.569796 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-a1808e8c-ea4c-4f77-b4f3-b8613c9792cd admin admin] Usage tracker for resource:security_group_rule and tenant:fb8571d77a0d4f31b806a30f3d370e3a is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:57.572842 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-a1808e8c-ea4c-4f77-b4f3-b8613c9792cd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:57.578671 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-a1808e8c-ea4c-4f77-b4f3-b8613c9792cd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:57.603015 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7ec98055-39e5-4932-9e9b-ad82f5508a81 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:57.629744 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7ec98055-39e5-4932-9e9b-ad82f5508a81 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:57.659656 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a1808e8c-ea4c-4f77-b4f3-b8613c9792cd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:57.820932 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a1808e8c-ea4c-4f77-b4f3-b8613c9792cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:57.829571 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7ec98055-39e5-4932-9e9b-ad82f5508a81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:57.836627 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:57.841719 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-30158014-0b1d-4f24-85bd-f9ba0301d1fb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:57.853792 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ec98055-39e5-4932-9e9b-ad82f5508a81 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=73988b87-5aeb-46e2-9da1-9dab0c5b5421,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:57.862584 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7ec98055-39e5-4932-9e9b-ad82f5508a81 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:57.864330 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7ec98055-39e5-4932-9e9b-ad82f5508a81 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:57.868591 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-7ec98055-39e5-4932-9e9b-ad82f5508a81 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/73988b87-5aeb-46e2-9da1-9dab0c5b5421 HTTP/1.1" status: 204  len: 168 time: 0.3348155
Jun 01 10:07:57.907429 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-a1808e8c-ea4c-4f77-b4f3-b8613c9792cd admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=fb8571d77a0d4f31b806a30f3d370e3a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4895649
Jun 01 10:07:57.907646 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 60348) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:57.915327 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1808e8c-ea4c-4f77-b4f3-b8613c9792cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ba44ff5-7bf5-43a7-b890-a3e8e90da03d,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:57.918345 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a1808e8c-ea4c-4f77-b4f3-b8613c9792cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:57.943477 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adb79f63-9e85-4514-ace8-952511a9562a req-c2b6af6f-97a3-4b51-9f3e-d2c9c6b9bc29 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:57.945040 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-adb79f63-9e85-4514-ace8-952511a9562a req-c2b6af6f-97a3-4b51-9f3e-d2c9c6b9bc29 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1640477
Jun 01 10:07:58.002828 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6a41de8e-166e-437f-b117-4c97bc6d4e34 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:58.035231 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6a41de8e-166e-437f-b117-4c97bc6d4e34 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:58.039792 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-adb79f63-9e85-4514-ace8-952511a9562a req-a4c5326b-3011-48e0-a453-2af3e4b34c3a tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0861537
Jun 01 10:07:58.182567 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6a41de8e-166e-437f-b117-4c97bc6d4e34 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:58.183449 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-1696cfac-10f6-4e3f-9320-e0849d27c6a7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:58.194678 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a41de8e-166e-437f-b117-4c97bc6d4e34 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ba44ff5-7bf5-43a7-b890-a3e8e90da03d,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:58.199458 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-6a41de8e-166e-437f-b117-4c97bc6d4e34 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:58.210729 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6a41de8e-166e-437f-b117-4c97bc6d4e34 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:58.214633 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-6a41de8e-166e-437f-b117-4c97bc6d4e34 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/6ba44ff5-7bf5-43a7-b890-a3e8e90da03d HTTP/1.1" status: 204  len: 168 time: 0.3059547
Jun 01 10:07:58.525214 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 60370) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:58.547329 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d76171e2-7aad-44e1-bb76-43260c8e53c4 req-def44ddd-dd35-4c02-be8a-095251a786a2 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:07:58.557549 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d76171e2-7aad-44e1-bb76-43260c8e53c4 req-def44ddd-dd35-4c02-be8a-095251a786a2 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 945 time: 0.0998349
Jun 01 10:07:58.600499 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d76171e2-7aad-44e1-bb76-43260c8e53c4 req-d51ee0cd-69e9-43a1-bf03-c94dddff7c23 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418606
Jun 01 10:07:58.776499 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-30435947-e680-4ff0-a797-6bc5fed0563d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:58.793000 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-30435947-e680-4ff0-a797-6bc5fed0563d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:07:58.797429 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-30435947-e680-4ff0-a797-6bc5fed0563d admin admin] Usage tracker for resource:security_group_rule and tenant:18506667146a4e9d86e951cb0752a45b is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:07:58.800783 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-30435947-e680-4ff0-a797-6bc5fed0563d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:07:58.807899 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-30435947-e680-4ff0-a797-6bc5fed0563d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:07:58.913879 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-30435947-e680-4ff0-a797-6bc5fed0563d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:59.038322 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-30435947-e680-4ff0-a797-6bc5fed0563d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:59.050293 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-0cdd6c37-3d2e-4557-ac96-8d7a2beda926 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:59.101751 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-30435947-e680-4ff0-a797-6bc5fed0563d admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=18506667146a4e9d86e951cb0752a45b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5702946
Jun 01 10:07:59.101751 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30435947-e680-4ff0-a797-6bc5fed0563d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bb522434-af6f-43ee-8a10-31c7e20f5be6,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:59.101751 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-30435947-e680-4ff0-a797-6bc5fed0563d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:59.103657 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 60392) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:07:59.188261 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-bd6fb4ba-0625-4a10-a7f8-59ca97f4a178 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:59.230664 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-bd6fb4ba-0625-4a10-a7f8-59ca97f4a178 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:59.462070 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-bd6fb4ba-0625-4a10-a7f8-59ca97f4a178 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:59.466468 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a99974ca-eb9b-44ea-ac53-a6cfd61039a3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:07:59.481303 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd6fb4ba-0625-4a10-a7f8-59ca97f4a178 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb522434-af6f-43ee-8a10-31c7e20f5be6,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:07:59.485104 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-bd6fb4ba-0625-4a10-a7f8-59ca97f4a178 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:07:59.512165 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-bd6fb4ba-0625-4a10-a7f8-59ca97f4a178 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:07:59.514812 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-bd6fb4ba-0625-4a10-a7f8-59ca97f4a178 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/bb522434-af6f-43ee-8a10-31c7e20f5be6 HTTP/1.1" status: 204  len: 168 time: 0.4086568
Jun 01 10:08:00.643396 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e3756c2-1c8f-4b85-acae-7eab29de800b req-93a9f054-f5a2-44bb-971c-299d3a936fd5 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:00.645027 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6e3756c2-1c8f-4b85-acae-7eab29de800b req-93a9f054-f5a2-44bb-971c-299d3a936fd5 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.0865974
Jun 01 10:08:00.719893 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6e3756c2-1c8f-4b85-acae-7eab29de800b req-9f4a966c-a054-4bcf-a667-8280b900d197 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0658960
Jun 01 10:08:01.041889 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a6af65-883a-4307-8834-a2e5ffe3f1d4 req-c6ea937e-5a4b-4eda-90d5-bedac53e1bd7 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:01.043466 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-65a6af65-883a-4307-8834-a2e5ffe3f1d4 req-c6ea937e-5a4b-4eda-90d5-bedac53e1bd7 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 945 time: 0.0861039
Jun 01 10:08:01.091821 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-65a6af65-883a-4307-8834-a2e5ffe3f1d4 req-15596c5e-5bd1-4362-ad9e-a102731d0fe6 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421965
Jun 01 10:08:02.298618 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aff6aba1-de6c-498b-bdcc-491ac1997dee req-404dd2ed-90e9-4ece-a009-202e8fa2a3f4 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:02.300140 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-aff6aba1-de6c-498b-bdcc-491ac1997dee req-404dd2ed-90e9-4ece-a009-202e8fa2a3f4 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 945 time: 0.0865915
Jun 01 10:08:02.351530 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-aff6aba1-de6c-498b-bdcc-491ac1997dee req-ca8141dc-7c8e-463e-a3c4-9600de8e3a2f tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397546
Jun 01 10:08:02.637782 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db6de90e-60e4-457d-b721-377873e4d7d2 req-836d1154-7e68-4ca2-bed4-c31d5fd7e3fd tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:02.639264 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-db6de90e-60e4-457d-b721-377873e4d7d2 req-836d1154-7e68-4ca2-bed4-c31d5fd7e3fd tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.30 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 945 time: 0.0876749
Jun 01 10:08:02.699436 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 60538) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:08:02.786257 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-db6de90e-60e4-457d-b721-377873e4d7d2 req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Deleting port 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:08:02.787280 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-db6de90e-60e4-457d-b721-377873e4d7d2 req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:02.829408 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:02.843967 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:08:02.847936 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Usage tracker for resource:security_group_rule and tenant:964d9ab317a34b01bcbd3e2211e17dec is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:08:02.851476 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:08:02.857750 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:08:02.929739 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-db6de90e-60e4-457d-b721-377873e4d7d2 req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] For port 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8,segment=NetworkSegment(a3eadacc-bc0f-438c-ba22-4e06ebfeec11),segment_id=a3eadacc-bc0f-438c-ba22-4e06ebfeec11)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:08:02.930198 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-db6de90e-60e4-457d-b721-377873e4d7d2 req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:02.942039 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:03.041631 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:03.051796 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-9df202d8-829c-429b-852d-c35434d77395 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:03.099117 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=964d9ab317a34b01bcbd3e2211e17dec&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3960469
Jun 01 10:08:03.099117 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 60550) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:08:03.101379 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9c97eac-8b05-49b6-82d4-58445259c098,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:03.133588 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-db6de90e-60e4-457d-b721-377873e4d7d2 req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Calling delete_port for 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 owned by compute:nova {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:08:03.163158 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.163565 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.164344 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.165235 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.166558 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.166558 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.167272 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.167795 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.168144 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.168490 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.168831 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.169177 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.173946 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:03.199630 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-35c30835-9a61-44ed-a82c-a5e777a29f8c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:03.229799 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-35c30835-9a61-44ed-a82c-a5e777a29f8c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:03.418285 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-db6de90e-60e4-457d-b721-377873e4d7d2 req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:03.425185 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:03.430493 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:08:03.500395 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Pushing event deleted for resources: {'Port': ['ID=5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:03.548277 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-35c30835-9a61-44ed-a82c-a5e777a29f8c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:03.549784 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.550186 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.550538 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.550886 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.551250 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.551643 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.551928 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.552292 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.552630 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.553171 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.553340 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.553503 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-3ea8b1c5-3335-4be3-a0a3-61b4a6c23c08 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:03.553691 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:03.562749 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-db6f3a17-8b6a-4c7c-8035-7a7251861e31 req-edf2a87a-a1c6-42f9-8419-9104e4eecafd tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 210 time: 0.0996108
Jun 01 10:08:03.563599 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:03.568683 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35c30835-9a61-44ed-a82c-a5e777a29f8c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9c97eac-8b05-49b6-82d4-58445259c098,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:03.578150 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-35c30835-9a61-44ed-a82c-a5e777a29f8c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:03.598249 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-35c30835-9a61-44ed-a82c-a5e777a29f8c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:03.599878 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-35c30835-9a61-44ed-a82c-a5e777a29f8c admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/c9c97eac-8b05-49b6-82d4-58445259c098 HTTP/1.1" status: 204  len: 168 time: 0.5010240
Jun 01 10:08:03.602929 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-db6de90e-60e4-457d-b721-377873e4d7d2 req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] No DVR routers for this DVR port 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 on host hv-cinder-78726 {{(pid=92566) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:08:03.606242 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-db6de90e-60e4-457d-b721-377873e4d7d2 req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:03.608279 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '759e40d4-f862-43a6-af5f-c75d3f29c250', 'name': 'network-vif-deleted', 'tag': '5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:08:03.610487 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c068c69a-05a6-4313-bb07-723c16c2e41c" -d '{"events": [{"server_uuid": "759e40d4-f862-43a6-af5f-c75d3f29c250", "name": "network-vif-deleted", "tag": "5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:08:03.657901 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:08:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-83b95228-848e-4d22-a312-7f8a0d98171a x-openstack-request-id: req-83b95228-848e-4d22-a312-7f8a0d98171a {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:08:03.658150 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "759e40d4-f862-43a6-af5f-c75d3f29c250", "name": "network-vif-deleted", "tag": "5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:08:03.658411 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-83b95228-848e-4d22-a312-7f8a0d98171a {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:08:03.658880 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '759e40d4-f862-43a6-af5f-c75d3f29c250', 'name': 'network-vif-deleted', 'tag': '5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8', 'status': 'completed', 'code': 200}
Jun 01 10:08:03.676004 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-db6de90e-60e4-457d-b721-377873e4d7d2 req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.30 "DELETE /v2.0/ports/5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 HTTP/1.1" status: 204  len: 173 time: 1.0309212
Jun 01 10:08:04.284032 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 60576) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:08:04.303067 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1a3e8c95-d64a-41f5-b0c6-14a4696072cf admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:04.317453 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-1a3e8c95-d64a-41f5-b0c6-14a4696072cf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:08:04.321209 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-1a3e8c95-d64a-41f5-b0c6-14a4696072cf admin admin] Usage tracker for resource:security_group_rule and tenant:96993730162b4beeb5a0b9dab73b516a is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:08:04.325315 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-1a3e8c95-d64a-41f5-b0c6-14a4696072cf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:08:04.329580 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-1a3e8c95-d64a-41f5-b0c6-14a4696072cf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:08:04.414884 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1a3e8c95-d64a-41f5-b0c6-14a4696072cf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:04.497986 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1a3e8c95-d64a-41f5-b0c6-14a4696072cf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:04.506846 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-6a41de8e-166e-437f-b117-4c97bc6d4e34 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:04.551832 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-1a3e8c95-d64a-41f5-b0c6-14a4696072cf admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=96993730162b4beeb5a0b9dab73b516a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2664523
Jun 01 10:08:04.553424 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a3e8c95-d64a-41f5-b0c6-14a4696072cf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=67432527-d608-48f3-9cce-7545fc2dde39,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:04.555201 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 60586) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:08:04.556590 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-1a3e8c95-d64a-41f5-b0c6-14a4696072cf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:04.617999 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7ab04cf3-d4c5-4e33-bacc-b1c7d0aab6a3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:04.647383 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7ab04cf3-d4c5-4e33-bacc-b1c7d0aab6a3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:04.751772 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-985e676a-c9c5-404a-ba0f-66905e9df6e5 req-80ed1557-5a1a-4e45-953f-d81d9aeb9dc5 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Synchronizing usage tracker for tenant:bf05ff611bcf4202aee423d3ef734d15 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:08:04.766434 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7ab04cf3-d4c5-4e33-bacc-b1c7d0aab6a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:04.777685 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-9058b0fd-b994-438d-a82c-8bdba9fa3ddb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:04.781390 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ab04cf3-d4c5-4e33-bacc-b1c7d0aab6a3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=67432527-d608-48f3-9cce-7545fc2dde39,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:04.785360 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7ab04cf3-d4c5-4e33-bacc-b1c7d0aab6a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:04.789612 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7ab04cf3-d4c5-4e33-bacc-b1c7d0aab6a3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:04.790710 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-7ab04cf3-d4c5-4e33-bacc-b1c7d0aab6a3 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/67432527-d608-48f3-9cce-7545fc2dde39 HTTP/1.1" status: 204  len: 168 time: 0.2343311
Jun 01 10:08:04.817983 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-985e676a-c9c5-404a-ba0f-66905e9df6e5 req-80ed1557-5a1a-4e45-953f-d81d9aeb9dc5 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Unset dirty status for tenant:bf05ff611bcf4202aee423d3ef734d15 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:08:04.819195 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-985e676a-c9c5-404a-ba0f-66905e9df6e5 req-80ed1557-5a1a-4e45-953f-d81d9aeb9dc5 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 210 time: 0.1117163
Jun 01 10:08:06.225708 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:08:06.268276 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:08:06.268276 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 5f4e62bf-e90c-44b1-9e76-3c8a771ec4d8 not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:08:07.434694 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e9608807-f28b-4c5f-b3c6-36e05d4fa551 req-0838fed7-3dc8-4d8d-abae-d924c788e7ed tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=759e40d4-f862-43a6-af5f-c75d3f29c250 HTTP/1.1" status: 200  len: 210 time: 0.0422359
Jun 01 10:08:07.468185 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:08:08.883973 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-6e5d413d-f361-4b64-9174-deb4102c8994 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:08.885410 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-6e5d413d-f361-4b64-9174-deb4102c8994 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/networks?id=3794c3e5-fe1f-49fc-8746-7fe7f2154093 HTTP/1.1" status: 200  len: 809 time: 0.1584046
Jun 01 10:08:08.900200 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-99b7b9fe-a8e2-4207-8911-09204b280b0e tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/quotas/bf05ff611bcf4202aee423d3ef734d15 HTTP/1.1" status: 200  len: 375 time: 0.0091941
Jun 01 10:08:08.949985 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2dfc54e-d15c-42b1-8e1c-37b7e2aa8a3f tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=bf05ff611bcf4202aee423d3ef734d15&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0445104
Jun 01 10:08:09.086251 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-ac5afca4-2c96-4435-8afd-ed7702353070 service neutron] 10.222.0.68 "GET /v2.0/networks/3794c3e5-fe1f-49fc-8746-7fe7f2154093?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1292088
Jun 01 10:08:09.231910 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-ce1f4df9-599a-4ee7-8638-6b140d001ebc service neutron] 10.222.0.68 "GET /v2.0/networks/3794c3e5-fe1f-49fc-8746-7fe7f2154093?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1401236
Jun 01 10:08:09.521578 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b362f153-bddb-4228-95d1-8e8dfded1e22 req-cfdf6edb-d0f2-425c-b92c-ddc25a57ebe1 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 210 time: 0.0509794
Jun 01 10:08:10.473127 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-de1cf481-91c8-4c82-9fc5-5cd8e6c2e604 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:12.393479 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f55ecb1f-365b-42c8-8997-1b08e38d4ecd req-8baa1789-ea24-4702-8967-89b23c77ae89 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 210 time: 0.0442412
Jun 01 10:08:12.977087 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-c19469b4-2588-42f9-9635-0ec2c947ceea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:13.302344 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:13.560261 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-21898cbf-484d-43a2-81f5-598354d6d802 req-aed8ea8b-9694-4e79-aebb-9c015d6ffef2 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 210 time: 0.0474343
Jun 01 10:08:13.969657 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9152824-31c7-404f-b3b0-325a155fce6d req-cfe36f9d-59b3-4c32-ae33-a14787e45616 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:13.971238 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-e9152824-31c7-404f-b3b0-325a155fce6d req-cfe36f9d-59b3-4c32-ae33-a14787e45616 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=ef4bc75ba53a44cca2e4b7c2b8aeb818&device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 1098 time: 0.0926960
Jun 01 10:08:14.012422 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-17609837-dcdb-4a5a-8d38-c27b8a1eec33 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:14.013867 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-17609837-dcdb-4a5a-8d38-c27b8a1eec33 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.30 "GET /v2.0/networks?id=3794c3e5-fe1f-49fc-8746-7fe7f2154093 HTTP/1.1" status: 200  len: 809 time: 0.2135274
Jun 01 10:08:14.025393 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e58f5b08-6580-4d8a-ae82-a26fa11d0d62 req-ba47b36a-bd82-4fe4-99e6-94ab25c83cb3 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:14.026818 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e58f5b08-6580-4d8a-ae82-a26fa11d0d62 req-ba47b36a-bd82-4fe4-99e6-94ab25c83cb3 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1487694
Jun 01 10:08:14.034334 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-bdf97ca5-68f7-469f-9e9f-c03c77eb1b9d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Request body: {'port': {'device_id': 'd3c167b0-cbf0-47d4-a690-0a026d019228', 'network_id': '3794c3e5-fe1f-49fc-8746-7fe7f2154093', 'admin_state_up': True, 'tenant_id': 'bf05ff611bcf4202aee423d3ef734d15'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:08:14.054020 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:14.119848 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9152824-31c7-404f-b3b0-325a155fce6d req-85f6257a-6774-444c-a169-541068f96608 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:14.121540 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-e9152824-31c7-404f-b3b0-325a155fce6d req-85f6257a-6774-444c-a169-541068f96608 service neutron] 10.222.0.30 "GET /v2.0/networks?id=34268ce8-8baf-41d5-acbc-1b6c167dd481 HTTP/1.1" status: 200  len: 920 time: 0.1412883
Jun 01 10:08:14.164974 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e58f5b08-6580-4d8a-ae82-a26fa11d0d62 req-c8b51a92-01e4-4d4d-8f21-5c5befe27606 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1113746
Jun 01 10:08:14.296003 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-e9152824-31c7-404f-b3b0-325a155fce6d req-dfacdc9a-e1bd-4bea-bd16-77ee17b3abe3 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=18b5c352-ee0c-425b-a1bf-666d362844b9 HTTP/1.1" status: 200  len: 217 time: 0.1672111
Jun 01 10:08:14.317736 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 60866) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:08:14.325008 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-bdf97ca5-68f7-469f-9e9f-c03c77eb1b9d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:08:14.335414 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-bdf97ca5-68f7-469f-9e9f-c03c77eb1b9d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:08:14.391349 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9152824-31c7-404f-b3b0-325a155fce6d req-0058febd-b92a-4488-876e-0288a8855480 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:14.393529 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-e9152824-31c7-404f-b3b0-325a155fce6d req-0058febd-b92a-4488-876e-0288a8855480 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2ee54c26-f286-4f9a-b791-24aa84feb26a HTTP/1.1" status: 200  len: 859 time: 0.0787106
Jun 01 10:08:14.447508 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-e9152824-31c7-404f-b3b0-325a155fce6d req-c5b1c548-41a4-4070-aa0c-6b5cfcbd446c service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=34268ce8-8baf-41d5-acbc-1b6c167dd481&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0455112
Jun 01 10:08:14.459993 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-27c43c7c-bc13-497b-af5b-3acdafd7d463 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:14.475045 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-27c43c7c-bc13-497b-af5b-3acdafd7d463 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:08:14.479358 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-27c43c7c-bc13-497b-af5b-3acdafd7d463 admin admin] Usage tracker for resource:security_group_rule and tenant:12176c7e6c324fe39dc6c188f47c0876 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:08:14.482162 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-27c43c7c-bc13-497b-af5b-3acdafd7d463 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:08:14.487422 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-bdf97ca5-68f7-469f-9e9f-c03c77eb1b9d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Made reservation on behalf of bf05ff611bcf4202aee423d3ef734d15 for: {'port': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:08:14.491069 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-bdf97ca5-68f7-469f-9e9f-c03c77eb1b9d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:14.499915 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-27c43c7c-bc13-497b-af5b-3acdafd7d463 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:08:14.649545 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-e9152824-31c7-404f-b3b0-325a155fce6d req-0888ec66-ee30-462b-b35f-da82c6c03eb4 service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1912487
Jun 01 10:08:14.764518 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-27c43c7c-bc13-497b-af5b-3acdafd7d463 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:14.839078 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-bdf97ca5-68f7-469f-9e9f-c03c77eb1b9d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Allocated IP 172.20.0.2 (3794c3e5-fe1f-49fc-8746-7fe7f2154093/f2cbb504-b9e2-47fc-88fd-eb43b0f783c6/d9c3d5eb-478d-4614-b706-c3e6efb826e8) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:08:14.865176 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-e9152824-31c7-404f-b3b0-325a155fce6d req-32cac3d4-07a8-4588-8ca7-4f75d2b98ff2 service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2089508
Jun 01 10:08:14.867067 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-484d55da-1992-4aba-9e52-58b1b100c3d0 req-8e626dca-4423-4002-bc80-142218267156 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 210 time: 0.1322036
Jun 01 10:08:14.868000 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-27c43c7c-bc13-497b-af5b-3acdafd7d463 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:14.881275 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1fd8cd85-42e7-4b88-bd81-39c76d317088 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:14.949676 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27c43c7c-bc13-497b-af5b-3acdafd7d463 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=098e31cd-ab04-4457-b8e2-9e24dbad2b2b,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:14.952930 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-27c43c7c-bc13-497b-af5b-3acdafd7d463 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:14.966784 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 60894) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:08:14.966957 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-27c43c7c-bc13-497b-af5b-3acdafd7d463 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=12176c7e6c324fe39dc6c188f47c0876&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6480596
Jun 01 10:08:15.048796 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6eaf3cc3-17f0-4c29-a66b-3b98bf869fdf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:15.075562 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6eaf3cc3-17f0-4c29-a66b-3b98bf869fdf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:15.162487 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-bdf97ca5-68f7-469f-9e9f-c03c77eb1b9d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:15.212956 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6eaf3cc3-17f0-4c29-a66b-3b98bf869fdf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:15.217976 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-12b52262-ea76-4f7f-a320-70c22d37ca03 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:15.230733 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6eaf3cc3-17f0-4c29-a66b-3b98bf869fdf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=098e31cd-ab04-4457-b8e2-9e24dbad2b2b,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:15.233388 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-6eaf3cc3-17f0-4c29-a66b-3b98bf869fdf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:15.241143 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6eaf3cc3-17f0-4c29-a66b-3b98bf869fdf admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:15.242324 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-6eaf3cc3-17f0-4c29-a66b-3b98bf869fdf admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/098e31cd-ab04-4457-b8e2-9e24dbad2b2b HTTP/1.1" status: 204  len: 168 time: 0.2741823
Jun 01 10:08:15.355821 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-bdf97ca5-68f7-469f-9e9f-c03c77eb1b9d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:15.364965 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-90acf61f-3bcb-4d52-82ab-a8078cf5a9ec tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:15.426725 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84ab0bab-8196-4dd0-ac73-c7e95d1ebb7c req-ed7ac3ee-0aa0-42da-9c98-3e603ac34172 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:15.428224 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-84ab0bab-8196-4dd0-ac73-c7e95d1ebb7c req-ed7ac3ee-0aa0-42da-9c98-3e603ac34172 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1457021
Jun 01 10:08:15.459263 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-bdf97ca5-68f7-469f-9e9f-c03c77eb1b9d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Network 3794c3e5-fe1f-49fc-8746-7fe7f2154093 is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:08:15.466621 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-bdf97ca5-68f7-469f-9e9f-c03c77eb1b9d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:08:15.472343 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-bdf97ca5-68f7-469f-9e9f-c03c77eb1b9d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:08:15.477427 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-bdf97ca5-68f7-469f-9e9f-c03c77eb1b9d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:15.478029 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-bdf97ca5-68f7-469f-9e9f-c03c77eb1b9d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:15.481790 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdf97ca5-68f7-469f-9e9f-c03c77eb1b9d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Pushing event updated for resources: {'Port': ['ID=d9c3d5eb-478d-4614-b706-c3e6efb826e8,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:15.492685 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-bdf97ca5-68f7-469f-9e9f-c03c77eb1b9d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:15.515636 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-84ab0bab-8196-4dd0-ac73-c7e95d1ebb7c req-a59762e5-70e7-4623-86f9-231b862cc7ab tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0785642
Jun 01 10:08:15.596006 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-bdf97ca5-68f7-469f-9e9f-c03c77eb1b9d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.5664222
Jun 01 10:08:15.608244 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Request body: {'port': {'device_id': 'd3c167b0-cbf0-47d4-a690-0a026d019228', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:08:15.741757 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:15.790874 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:16.189851 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3d3eff9-dd7f-4f5d-ae78-add0f2c5982e req-b7378cf2-32a0-44d9-9bef-95f57716fb39 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:16.190564 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-b3d3eff9-dd7f-4f5d-ae78-add0f2c5982e req-b7378cf2-32a0-44d9-9bef-95f57716fb39 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Synchronizing usage tracker for tenant:bf05ff611bcf4202aee423d3ef734d15 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:08:16.280687 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d9c3d5eb-478d-4614-b706-c3e6efb826e8 {{(pid=92566) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:08:16.290203 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:16.306673 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Transition to ACTIVE for port object d9c3d5eb-478d-4614-b706-c3e6efb826e8 will not be triggered until provisioned by entity L2. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:08:16.370862 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-b3d3eff9-dd7f-4f5d-ae78-add0f2c5982e req-b7378cf2-32a0-44d9-9bef-95f57716fb39 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Unset dirty status for tenant:bf05ff611bcf4202aee423d3ef734d15 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:08:16.372152 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b3d3eff9-dd7f-4f5d-ae78-add0f2c5982e req-b7378cf2-32a0-44d9-9bef-95f57716fb39 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 931 time: 0.3320000
Jun 01 10:08:16.419917 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b3d3eff9-dd7f-4f5d-ae78-add0f2c5982e req-4701246b-ee74-4e2a-928a-340d22c26c81 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417073
Jun 01 10:08:16.503658 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:16.507664 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:16.677704 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Pushing event updated for resources: {'Port': ['ID=d9c3d5eb-478d-4614-b706-c3e6efb826e8,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:16.716943 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:16.736934 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Attempting to bind port d9c3d5eb-478d-4614-b706-c3e6efb826e8 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:08:16.737267 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Attempting to bind port d9c3d5eb-478d-4614-b706-c3e6efb826e8 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': 'a3eadacc-bc0f-438c-ba22-4e06ebfeec11', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '3794c3e5-fe1f-49fc-8746-7fe7f2154093'}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:08:16.737615 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Attempting to bind port d9c3d5eb-478d-4614-b706-c3e6efb826e8 on network 3794c3e5-fe1f-49fc-8746-7fe7f2154093 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:08:16.751562 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Port d9c3d5eb-478d-4614-b706-c3e6efb826e8 on network 3794c3e5-fe1f-49fc-8746-7fe7f2154093 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:08:16.752535 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Attempting to bind port d9c3d5eb-478d-4614-b706-c3e6efb826e8 on network 3794c3e5-fe1f-49fc-8746-7fe7f2154093 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:08:16.761088 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 7, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:08:16.761503 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Checking segment: {'id': 'a3eadacc-bc0f-438c-ba22-4e06ebfeec11', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '3794c3e5-fe1f-49fc-8746-7fe7f2154093'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:08:16.761885 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Bound using segment: {'id': 'a3eadacc-bc0f-438c-ba22-4e06ebfeec11', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '3794c3e5-fe1f-49fc-8746-7fe7f2154093'} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:08:16.762315 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Bound port: d9c3d5eb-478d-4614-b706-c3e6efb826e8, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a3eadacc-bc0f-438c-ba22-4e06ebfeec11', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '3794c3e5-fe1f-49fc-8746-7fe7f2154093'}}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:08:16.762663 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:16.956742 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-702afa3d-2e8c-434f-9ece-9a8d1d1447ca req-919b8934-f5c7-47dc-b841-1a1f60b3ff51 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:16.956742 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-702afa3d-2e8c-434f-9ece-9a8d1d1447ca req-919b8934-f5c7-47dc-b841-1a1f60b3ff51 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.2801399
Jun 01 10:08:17.005624 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] For port d9c3d5eb-478d-4614-b706-c3e6efb826e8, host hv-cinder-78726, cleared binding levels {{(pid=92566) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:08:17.015937 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-702afa3d-2e8c-434f-9ece-9a8d1d1447ca req-5a860176-6ff3-4aca-8e0c-362ea741ed3e tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0575211
Jun 01 10:08:17.018476 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] For port d9c3d5eb-478d-4614-b706-c3e6efb826e8, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=d9c3d5eb-478d-4614-b706-c3e6efb826e8,segment=NetworkSegment(a3eadacc-bc0f-438c-ba22-4e06ebfeec11),segment_id=a3eadacc-bc0f-438c-ba22-4e06ebfeec11)] {{(pid=92566) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:08:17.115845 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:17.120406 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-79654ca5-2779-443f-b5f6-7c9bb90677c2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:17.184889 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:17.185520 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:17.186944 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] 10.222.0.30 "PUT /v2.0/ports/d9c3d5eb-478d-4614-b706-c3e6efb826e8 HTTP/1.1" status: 200  len: 1093 time: 1.5828125
Jun 01 10:08:17.187371 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd3c167b0-cbf0-47d4-a690-0a026d019228', 'tag': 'd9c3d5eb-478d-4614-b706-c3e6efb826e8'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:08:17.191011 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e3c4b332-29ed-4b77-8494-0ece26d2ce12" -d '{"events": [{"name": "network-changed", "server_uuid": "d3c167b0-cbf0-47d4-a690-0a026d019228", "tag": "d9c3d5eb-478d-4614-b706-c3e6efb826e8"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:08:17.223178 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Pushing event updated for resources: {'Port': ['ID=d9c3d5eb-478d-4614-b706-c3e6efb826e8,revision_number=3']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:17.256081 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:17.259194 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:08:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fcc7dddc-2fc7-47a6-8110-438d8243d88e x-openstack-request-id: req-fcc7dddc-2fc7-47a6-8110-438d8243d88e {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:08:17.259676 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d3c167b0-cbf0-47d4-a690-0a026d019228", "tag": "d9c3d5eb-478d-4614-b706-c3e6efb826e8", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:08:17.260091 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-fcc7dddc-2fc7-47a6-8110-438d8243d88e {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:08:17.260641 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd3c167b0-cbf0-47d4-a690-0a026d019228', 'tag': 'd9c3d5eb-478d-4614-b706-c3e6efb826e8', 'status': 'completed', 'code': 200}
Jun 01 10:08:17.366081 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c4b332-29ed-4b77-8494-0ece26d2ce12 req-bfb6c5ca-2d2d-470f-b428-a612ccf6f0aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:17.368054 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e3c4b332-29ed-4b77-8494-0ece26d2ce12 req-bfb6c5ca-2d2d-470f-b428-a612ccf6f0aa service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=bf05ff611bcf4202aee423d3ef734d15&device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 1096 time: 0.0866492
Jun 01 10:08:17.531939 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c4b332-29ed-4b77-8494-0ece26d2ce12 req-6d665976-572a-4601-9293-19c8c6ae9802 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:17.533416 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e3c4b332-29ed-4b77-8494-0ece26d2ce12 req-6d665976-572a-4601-9293-19c8c6ae9802 service neutron] 10.222.0.30 "GET /v2.0/networks?tenant_id=bf05ff611bcf4202aee423d3ef734d15&shared=False HTTP/1.1" status: 200  len: 910 time: 0.1540926
Jun 01 10:08:17.734845 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-834ab742-3094-4aef-a852-930b0a66d2c2 req-6f2ae59a-2444-4ee0-9bb0-30fc7ca03573 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:17.736349 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-834ab742-3094-4aef-a852-930b0a66d2c2 req-6f2ae59a-2444-4ee0-9bb0-30fc7ca03573 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 943 time: 0.1997082
Jun 01 10:08:17.739069 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c4b332-29ed-4b77-8494-0ece26d2ce12 req-d5dce17e-0f70-4b3d-8a56-889d6c3b3c59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:17.740442 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e3c4b332-29ed-4b77-8494-0ece26d2ce12 req-d5dce17e-0f70-4b3d-8a56-889d6c3b3c59 service neutron] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1680913
Jun 01 10:08:17.788668 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-834ab742-3094-4aef-a852-930b0a66d2c2 req-4a0dba67-9ecf-4a02-9181-1c4f684b17c4 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0460677
Jun 01 10:08:17.865858 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-28c5d458-a944-4526-9d5d-715e8f774124 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:17.868432 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-28c5d458-a944-4526-9d5d-715e8f774124 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=bf05ff611bcf4202aee423d3ef734d15&device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 1096 time: 0.0789428
Jun 01 10:08:17.944773 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-5c0f6947-0307-4f77-96a5-9e85ceb6e352 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=d9c3d5eb-478d-4614-b706-c3e6efb826e8 HTTP/1.1" status: 200  len: 217 time: 0.0682504
Jun 01 10:08:18.022219 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-9e032d94-ae2b-462c-88fe-33032df236bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:18.024948 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-9e032d94-ae2b-462c-88fe-33032df236bd service neutron] 10.222.0.30 "GET /v2.0/subnets?id=f2cbb504-b9e2-47fc-88fd-eb43b0f783c6 HTTP/1.1" status: 200  len: 849 time: 0.0697391
Jun 01 10:08:18.087595 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-701c34a2-c1d7-4b32-8886-4035f3000d11 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=3794c3e5-fe1f-49fc-8746-7fe7f2154093&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0549223
Jun 01 10:08:18.285883 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-be8e07c7-eafc-46d8-85f8-8f7976deabaa service neutron] 10.222.0.30 "GET /v2.0/networks/3794c3e5-fe1f-49fc-8746-7fe7f2154093?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1912618
Jun 01 10:08:18.333800 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-411eb7c9-448e-4d94-862a-8514ad28cac2 req-7a734820-b100-4867-adae-b20422c50593 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:18.335449 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-411eb7c9-448e-4d94-862a-8514ad28cac2 req-7a734820-b100-4867-adae-b20422c50593 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1681075
Jun 01 10:08:18.457405 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-411eb7c9-448e-4d94-862a-8514ad28cac2 req-cf623eea-5662-4e23-9d11-98ae9093f169 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0726178
Jun 01 10:08:18.483760 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-86e1da06-4218-4e24-a5ba-590cbff89d2b req-165f909e-cf12-4a6c-8d42-7223d142a273 service neutron] 10.222.0.30 "GET /v2.0/networks/3794c3e5-fe1f-49fc-8746-7fe7f2154093?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1874161
Jun 01 10:08:18.893285 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f71f4acf-22b0-4e6a-a55b-ae057411e30f req-c89c0f81-7ac0-453a-81f0-feb9598a7f4b tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:18.894749 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f71f4acf-22b0-4e6a-a55b-ae057411e30f req-c89c0f81-7ac0-453a-81f0-feb9598a7f4b tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.0851796
Jun 01 10:08:18.993516 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f71f4acf-22b0-4e6a-a55b-ae057411e30f req-803d4c29-a79c-41b5-861c-c83941616cfd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0913799
Jun 01 10:08:19.017362 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-917b0a7c-6f97-4240-a7dd-e3552f395338 req-1b49efb2-9774-415d-b165-2605acf18563 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:19.018886 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-917b0a7c-6f97-4240-a7dd-e3552f395338 req-1b49efb2-9774-415d-b165-2605acf18563 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 943 time: 0.1184807
Jun 01 10:08:19.062986 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-917b0a7c-6f97-4240-a7dd-e3552f395338 req-b31161f2-b14e-434b-ab05-068833ab42a1 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383470
Jun 01 10:08:19.657148 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71f4d672-ef7b-4e7e-b054-ce4b7aaef661 req-63cb6563-0efe-434a-89e0-d6070d2e16c7 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:19.658615 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-71f4d672-ef7b-4e7e-b054-ce4b7aaef661 req-63cb6563-0efe-434a-89e0-d6070d2e16c7 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.0828500
Jun 01 10:08:19.705638 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-71f4d672-ef7b-4e7e-b054-ce4b7aaef661 req-2e2c1b03-d077-41ec-81e2-cd83bbd8c615 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413268
Jun 01 10:08:20.298446 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a16c798-761c-4e91-96c8-bedc75d3af57 req-eb789bd9-a1b2-4154-b9ac-0ffcc4c77e5f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:20.300098 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9a16c798-761c-4e91-96c8-bedc75d3af57 req-eb789bd9-a1b2-4154-b9ac-0ffcc4c77e5f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1973896
Jun 01 10:08:20.370963 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9a16c798-761c-4e91-96c8-bedc75d3af57 req-3268a669-1572-467e-8b25-c640d5b80e25 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0602024
Jun 01 10:08:20.388223 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96e04379-d77b-4e00-84cc-53c3ed29c2f1 req-db94e5a3-1627-4d81-b978-d22402dfc008 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:20.389686 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-96e04379-d77b-4e00-84cc-53c3ed29c2f1 req-db94e5a3-1627-4d81-b978-d22402dfc008 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 943 time: 0.2193844
Jun 01 10:08:20.435647 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-96e04379-d77b-4e00-84cc-53c3ed29c2f1 req-004a5236-308d-44e7-8d93-33d41475e8da tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400698
Jun 01 10:08:20.891769 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaf0cae7-5c79-44e6-97f7-2fc23bb8a8b4 req-8422067f-4919-458f-88fc-18d8df69515b tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:20.893106 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-aaf0cae7-5c79-44e6-97f7-2fc23bb8a8b4 req-8422067f-4919-458f-88fc-18d8df69515b tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.0830300
Jun 01 10:08:20.937670 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-aaf0cae7-5c79-44e6-97f7-2fc23bb8a8b4 req-0816486f-0d1f-4d32-ba1d-afe90b6aa0f4 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387230
Jun 01 10:08:21.615728 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0114041-ba92-4436-820a-9c63b434f2d1 req-840c2384-289a-4286-8e33-c71a391d732f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:21.618115 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f0114041-ba92-4436-820a-9c63b434f2d1 req-840c2384-289a-4286-8e33-c71a391d732f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1344256
Jun 01 10:08:21.670995 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c859e677-b362-4735-ba47-a40c915e7565 req-69c008c8-c79a-4074-a1ec-09582fbcfae1 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:21.672111 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c859e677-b362-4735-ba47-a40c915e7565 req-69c008c8-c79a-4074-a1ec-09582fbcfae1 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 943 time: 0.1273088
Jun 01 10:08:21.696349 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f0114041-ba92-4436-820a-9c63b434f2d1 req-cac1a33c-0e57-42b1-9d10-0c7a60a57cf9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0715454
Jun 01 10:08:21.729702 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c859e677-b362-4735-ba47-a40c915e7565 req-120b2dc4-1cfb-4b32-ac93-ec3c8fba60b6 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0507555
Jun 01 10:08:22.150101 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3105e6b3-f558-4372-9726-e61ff043591f req-a0a2bddd-2e71-4948-a1fb-4160b4baef06 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1340528
Jun 01 10:08:22.161065 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-863c7e44-0317-40c0-a784-d8806c7a73e4 req-7337a4b1-12dd-48e4-88cd-102196807b6b tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:22.162482 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-863c7e44-0317-40c0-a784-d8806c7a73e4 req-7337a4b1-12dd-48e4-88cd-102196807b6b tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1132157
Jun 01 10:08:22.265445 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-863c7e44-0317-40c0-a784-d8806c7a73e4 req-86b11b9e-5402-4776-99db-145d3dfd45d8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0970032
Jun 01 10:08:22.282528 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3105e6b3-f558-4372-9726-e61ff043591f req-7e3f7a81-d717-4c8f-a3c5-7143dc7957b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:22.284079 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3105e6b3-f558-4372-9726-e61ff043591f req-7e3f7a81-d717-4c8f-a3c5-7143dc7957b5 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=ef4bc75ba53a44cca2e4b7c2b8aeb818&device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 1099 time: 0.1023986
Jun 01 10:08:22.442780 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3105e6b3-f558-4372-9726-e61ff043591f req-e6852ef2-3b0e-4abb-912d-e969931cc423 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:22.444252 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3105e6b3-f558-4372-9726-e61ff043591f req-e6852ef2-3b0e-4abb-912d-e969931cc423 service neutron] 10.222.0.30 "GET /v2.0/networks?id=34268ce8-8baf-41d5-acbc-1b6c167dd481 HTTP/1.1" status: 200  len: 920 time: 0.1328945
Jun 01 10:08:22.516228 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3105e6b3-f558-4372-9726-e61ff043591f req-13ef01c9-8b92-4313-8023-b2c909cdae2e service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ea668f76-dcbd-410c-a737-019b6396ac7f HTTP/1.1" status: 200  len: 217 time: 0.0642636
Jun 01 10:08:22.579141 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3105e6b3-f558-4372-9726-e61ff043591f req-f0276f8a-c5a8-4fa4-91e6-0722381692b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:22.580637 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3105e6b3-f558-4372-9726-e61ff043591f req-f0276f8a-c5a8-4fa4-91e6-0722381692b9 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2ee54c26-f286-4f9a-b791-24aa84feb26a HTTP/1.1" status: 200  len: 859 time: 0.0572748
Jun 01 10:08:22.629737 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3105e6b3-f558-4372-9726-e61ff043591f req-fa887419-8913-4caa-bb6d-fe7fd2df61be service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=34268ce8-8baf-41d5-acbc-1b6c167dd481&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0394521
Jun 01 10:08:22.771294 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3105e6b3-f558-4372-9726-e61ff043591f req-bfc9e124-20ed-452b-8054-9084a3e739c7 service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1338651
Jun 01 10:08:23.058088 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3105e6b3-f558-4372-9726-e61ff043591f req-273222fb-6742-4959-bd94-266c133931a3 service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2793128
Jun 01 10:08:23.080106 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9c53579-ca16-463c-b022-9e75d7aa9115 req-be8d3754-d2fb-4f8b-8cf1-53c5a7017ab0 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:23.081613 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e9c53579-ca16-463c-b022-9e75d7aa9115 req-be8d3754-d2fb-4f8b-8cf1-53c5a7017ab0 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1921594
Jun 01 10:08:23.092455 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ce12daa-df6a-41b9-b5bb-7dda8a188090 req-a5787dbe-3d69-4dfc-aa6c-b0879240d2be tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:23.094205 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6ce12daa-df6a-41b9-b5bb-7dda8a188090 req-a5787dbe-3d69-4dfc-aa6c-b0879240d2be tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 943 time: 0.2099500
Jun 01 10:08:23.167052 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e9c53579-ca16-463c-b022-9e75d7aa9115 req-a87ba2e3-c4c3-472f-8549-ac5a643f29b1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0718207
Jun 01 10:08:23.173924 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6ce12daa-df6a-41b9-b5bb-7dda8a188090 req-8787ebbc-189d-48ed-b89a-4729f74fbb2a tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0630410
Jun 01 10:08:23.453450 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac9a72fc-7b5f-47c5-bec2-d686d172ea66 req-4173422c-1ee7-4150-a61d-5c2c67b54a84 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:23.455342 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac9a72fc-7b5f-47c5-bec2-d686d172ea66 req-4173422c-1ee7-4150-a61d-5c2c67b54a84 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.0825825
Jun 01 10:08:23.502291 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac9a72fc-7b5f-47c5-bec2-d686d172ea66 req-0d9c0434-e9e6-4da0-bf67-37c2d4e3c708 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401914
Jun 01 10:08:24.512334 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-795552df-473d-4cc5-a276-ed23790e6203 req-b91707fa-e8a0-4c45-8955-7327ac27fe5f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:24.513795 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-795552df-473d-4cc5-a276-ed23790e6203 req-b91707fa-e8a0-4c45-8955-7327ac27fe5f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.2251410
Jun 01 10:08:24.521704 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b1173c9-9045-42ba-ac0b-7e716d50087b req-ebe2cab5-e89d-4422-9831-e98023a4c794 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:24.523269 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6b1173c9-9045-42ba-ac0b-7e716d50087b req-ebe2cab5-e89d-4422-9831-e98023a4c794 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 943 time: 0.2369282
Jun 01 10:08:24.595989 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-795552df-473d-4cc5-a276-ed23790e6203 req-abb8bde1-ca82-45db-9b27-c91874819d07 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0717099
Jun 01 10:08:24.600476 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6b1173c9-9045-42ba-ac0b-7e716d50087b req-af5a85a0-2183-4379-80af-dffb5e2db2b8 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0621445
Jun 01 10:08:24.790026 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9bf6d52-25e4-4a0e-8dd4-86dbd9456dd3 req-ebc6948a-a27f-451a-874a-e296c4679113 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:24.791769 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d9bf6d52-25e4-4a0e-8dd4-86dbd9456dd3 req-ebc6948a-a27f-451a-874a-e296c4679113 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.0914259
Jun 01 10:08:24.843604 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d9bf6d52-25e4-4a0e-8dd4-86dbd9456dd3 req-4144b703-fc7a-4b31-a242-9b1203ce4a15 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0444183
Jun 01 10:08:25.611328 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c96fbce-daf1-404a-b4b7-774520375b21 req-31a01c17-f4ac-480e-ad64-ad15859669f6 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:25.612947 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7c96fbce-daf1-404a-b4b7-774520375b21 req-31a01c17-f4ac-480e-ad64-ad15859669f6 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0808487
Jun 01 10:08:25.664891 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7c96fbce-daf1-404a-b4b7-774520375b21 req-2a7bb5cb-124d-47b4-95bb-3d3082caa65a tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0432456
Jun 01 10:08:25.711388 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device d9c3d5eb-478d-4614-b706-c3e6efb826e8 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:08:25.811467 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5c78c01-2718-4663-ae20-71059a23f03c req-5230f062-fad2-4282-a034-c105a5acc2ab tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:25.813405 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e5c78c01-2718-4663-ae20-71059a23f03c req-5230f062-fad2-4282-a034-c105a5acc2ab tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 943 time: 0.0923119
Jun 01 10:08:25.861614 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port d9c3d5eb-478d-4614-b706-c3e6efb826e8, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=d9c3d5eb-478d-4614-b706-c3e6efb826e8,segment=NetworkSegment(a3eadacc-bc0f-438c-ba22-4e06ebfeec11),segment_id=a3eadacc-bc0f-438c-ba22-4e06ebfeec11)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:08:25.875798 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e5c78c01-2718-4663-ae20-71059a23f03c req-72d5763c-73b1-4d99-b3ba-98ac2815e500 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0469177
Jun 01 10:08:25.877416 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': 'd9c3d5eb-478d-4614-b706-c3e6efb826e8', 'network_id': '3794c3e5-fe1f-49fc-8746-7fe7f2154093', 'port_id': 'd9c3d5eb-478d-4614-b706-c3e6efb826e8', 'mac_address': 'fa:16:3e:ba:b3:93', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 884, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f2cbb504-b9e2-47fc-88fd-eb43b0f783c6', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:08:25.936556 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:25.956122 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d9c3d5eb-478d-4614-b706-c3e6efb826e8 {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:08:25.972632 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port d9c3d5eb-478d-4614-b706-c3e6efb826e8, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=d9c3d5eb-478d-4614-b706-c3e6efb826e8,segment=NetworkSegment(a3eadacc-bc0f-438c-ba22-4e06ebfeec11),segment_id=a3eadacc-bc0f-438c-ba22-4e06ebfeec11)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:08:26.035006 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:26.036829 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:26.073679 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad43c6f9-557c-426c-95ca-1860fc0255bc req-f395aae7-3a97-484c-9b89-54babba368de tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:26.077419 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ad43c6f9-557c-426c-95ca-1860fc0255bc req-f395aae7-3a97-484c-9b89-54babba368de tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1482294
Jun 01 10:08:26.115262 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9b64086-dd9d-4ea7-9e64-ba3fa05bf6bd req-5f21d942-1ae0-41a8-b21d-1093fc590927 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:26.115593 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=d9c3d5eb-478d-4614-b706-c3e6efb826e8,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:26.117295 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f9b64086-dd9d-4ea7-9e64-ba3fa05bf6bd req-5f21d942-1ae0-41a8-b21d-1093fc590927 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1324375
Jun 01 10:08:26.125256 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:26.154017 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ad43c6f9-557c-426c-95ca-1860fc0255bc req-d55c1e6c-ce19-445c-8206-693854661250 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0727870
Jun 01 10:08:26.172309 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:26.177674 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f9b64086-dd9d-4ea7-9e64-ba3fa05bf6bd req-16ae8414-bcbb-4fa2-83d0-d66601441762 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0499573
Jun 01 10:08:26.379683 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['d9c3d5eb-478d-4614-b706-c3e6efb826e8'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:08:26.854419 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e69dd27-d73b-40ec-a6b5-dcaaa7ac1688 req-046370b4-c681-443b-be07-dfd07317a7fb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:26.855996 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9e69dd27-d73b-40ec-a6b5-dcaaa7ac1688 req-046370b4-c681-443b-be07-dfd07317a7fb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0833015
Jun 01 10:08:26.900922 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9e69dd27-d73b-40ec-a6b5-dcaaa7ac1688 req-63aabf80-6385-4f4a-bd58-2e366593a1a4 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391831
Jun 01 10:08:27.061280 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91b9b6df-485a-4272-873a-ec8d1582a297 req-fa9f2f6a-7652-4cb8-bbd2-c7b02deecab1 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:27.062644 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-91b9b6df-485a-4272-873a-ec8d1582a297 req-fa9f2f6a-7652-4cb8-bbd2-c7b02deecab1 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 944 time: 0.0803249
Jun 01 10:08:27.105959 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-91b9b6df-485a-4272-873a-ec8d1582a297 req-7d3a0a19-1b3d-4ba6-9772-d931c15b8950 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0375686
Jun 01 10:08:27.418216 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5bddea1-0734-42a4-897d-874965ea0dd2 req-99cb01c6-f7a4-4936-a735-0922874b1e27 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:27.419757 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e5bddea1-0734-42a4-897d-874965ea0dd2 req-99cb01c6-f7a4-4936-a735-0922874b1e27 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1462882
Jun 01 10:08:27.449576 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3b8e888-72d8-4536-8c31-0345574f2653 req-3ea61838-6330-4b1e-a2b2-97f0dd6c36ca tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:27.451161 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c3b8e888-72d8-4536-8c31-0345574f2653 req-3ea61838-6330-4b1e-a2b2-97f0dd6c36ca tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1419466
Jun 01 10:08:27.508805 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e5bddea1-0734-42a4-897d-874965ea0dd2 req-7d588446-2759-4fa8-9ef3-666fbc920b31 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0823891
Jun 01 10:08:27.516050 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c3b8e888-72d8-4536-8c31-0345574f2653 req-a3aa6c91-ee79-4d7a-a6fe-63e911c1b698 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0591707
Jun 01 10:08:27.718546 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device d9c3d5eb-478d-4614-b706-c3e6efb826e8 up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:08:27.835067 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port d9c3d5eb-478d-4614-b706-c3e6efb826e8 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:08:27.840740 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port d9c3d5eb-478d-4614-b706-c3e6efb826e8 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:08:27.841107 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:27.962159 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:27.993197 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd3c167b0-cbf0-47d4-a690-0a026d019228', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd9c3d5eb-478d-4614-b706-c3e6efb826e8'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:08:27.995656 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8112cdc7-0dae-4a84-98e7-903fc2f2d8bf" -d '{"events": [{"server_uuid": "d3c167b0-cbf0-47d4-a690-0a026d019228", "name": "network-vif-plugged", "status": "completed", "tag": "d9c3d5eb-478d-4614-b706-c3e6efb826e8"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:08:28.003939 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port d9c3d5eb-478d-4614-b706-c3e6efb826e8, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=d9c3d5eb-478d-4614-b706-c3e6efb826e8,segment=NetworkSegment(a3eadacc-bc0f-438c-ba22-4e06ebfeec11),segment_id=a3eadacc-bc0f-438c-ba22-4e06ebfeec11)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:08:28.043408 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:08:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b31607d9-241a-485e-8012-ccc1f376e454 x-openstack-request-id: req-b31607d9-241a-485e-8012-ccc1f376e454 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:08:28.043776 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d3c167b0-cbf0-47d4-a690-0a026d019228", "name": "network-vif-plugged", "status": "completed", "tag": "d9c3d5eb-478d-4614-b706-c3e6efb826e8", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:08:28.043935 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-b31607d9-241a-485e-8012-ccc1f376e454 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:08:28.044332 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd3c167b0-cbf0-47d4-a690-0a026d019228', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd9c3d5eb-478d-4614-b706-c3e6efb826e8', 'code': 200}
Jun 01 10:08:28.085601 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:28.089699 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:28.103027 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2947457-9bb4-4616-aef4-e7e8018da05b req-e2ae2052-801b-48bd-b1e4-7133737ba527 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:28.104547 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a2947457-9bb4-4616-aef4-e7e8018da05b req-e2ae2052-801b-48bd-b1e4-7133737ba527 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0904989
Jun 01 10:08:28.158165 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a2947457-9bb4-4616-aef4-e7e8018da05b req-49f3dc62-37a2-447c-87ed-23e2c725126e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0476465
Jun 01 10:08:28.193948 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=d9c3d5eb-478d-4614-b706-c3e6efb826e8,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:28.198163 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:28.309096 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e3dc5d8-fd6f-4412-ac11-23e252e5fcc7 req-e42bf3d6-3bd2-4e69-a29d-87cfc302b3a1 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:28.310604 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9e3dc5d8-fd6f-4412-ac11-23e252e5fcc7 req-e42bf3d6-3bd2-4e69-a29d-87cfc302b3a1 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 945 time: 0.0841887
Jun 01 10:08:28.355960 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9e3dc5d8-fd6f-4412-ac11-23e252e5fcc7 req-bf0b376d-deee-432f-95a8-6ed385a84f58 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390298
Jun 01 10:08:28.493179 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea21b296-cbb6-411a-a89d-a1180469100c req-7bfcc9e0-08c7-47c7-8195-46fe04d424d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:28.494207 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ea21b296-cbb6-411a-a89d-a1180469100c req-7bfcc9e0-08c7-47c7-8195-46fe04d424d1 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 1098 time: 0.0706496
Jun 01 10:08:28.537689 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ea21b296-cbb6-411a-a89d-a1180469100c req-18dd717d-344c-4b40-ad68-be462447136d service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0340509
Jun 01 10:08:28.578077 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 32890) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:08:28.735249 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1e386557-86be-4f49-892c-bc93ea57eebb admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:28.770181 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-1e386557-86be-4f49-892c-bc93ea57eebb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:08:28.776181 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-1e386557-86be-4f49-892c-bc93ea57eebb admin admin] Usage tracker for resource:security_group_rule and tenant:aacd136c494840b59aeed01643398e31 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:08:28.781432 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-1e386557-86be-4f49-892c-bc93ea57eebb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:08:28.788085 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-1e386557-86be-4f49-892c-bc93ea57eebb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:08:28.830250 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af11cd48-06ff-41b5-90c2-de7d862b3edb req-02f3ca12-92c7-4aa8-8072-278f9bb7de89 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:28.831747 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-af11cd48-06ff-41b5-90c2-de7d862b3edb req-02f3ca12-92c7-4aa8-8072-278f9bb7de89 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1706700
Jun 01 10:08:28.843894 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc4b59b7-bf3a-4803-aca4-4821f4cee1ee req-e2b7d08b-0b93-4ac2-a730-b6f975916f67 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:28.845291 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fc4b59b7-bf3a-4803-aca4-4821f4cee1ee req-e2b7d08b-0b93-4ac2-a730-b6f975916f67 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.2192440
Jun 01 10:08:28.930665 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-af11cd48-06ff-41b5-90c2-de7d862b3edb req-74c5b0d8-084a-451e-ada1-6fde0ef760eb tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0838475
Jun 01 10:08:28.936780 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fc4b59b7-bf3a-4803-aca4-4821f4cee1ee req-185090c7-ffa1-4440-afcf-aff64fc16056 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0733843
Jun 01 10:08:28.979632 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1e386557-86be-4f49-892c-bc93ea57eebb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:29.046686 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1e386557-86be-4f49-892c-bc93ea57eebb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:29.053253 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6e7ea8d6-de4f-4430-b853-fa9b83d92b40 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:29.093730 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-1e386557-86be-4f49-892c-bc93ea57eebb admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=aacd136c494840b59aeed01643398e31&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5144269
Jun 01 10:08:29.094844 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e386557-86be-4f49-892c-bc93ea57eebb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=11cee097-2fc6-4220-a3fc-2008b4145779,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:29.096444 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 32896) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:08:29.098235 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1e386557-86be-4f49-892c-bc93ea57eebb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:29.157142 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6adfd760-36cb-4978-b5a8-145225f4a50a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:29.183019 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6adfd760-36cb-4978-b5a8-145225f4a50a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:29.321347 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6adfd760-36cb-4978-b5a8-145225f4a50a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:29.325215 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-65de3f6a-4821-4449-b051-0990ef2b89d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:29.340360 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6adfd760-36cb-4978-b5a8-145225f4a50a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=11cee097-2fc6-4220-a3fc-2008b4145779,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:29.344175 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-6adfd760-36cb-4978-b5a8-145225f4a50a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:29.347651 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6adfd760-36cb-4978-b5a8-145225f4a50a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:29.351179 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-6adfd760-36cb-4978-b5a8-145225f4a50a admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/11cee097-2fc6-4220-a3fc-2008b4145779 HTTP/1.1" status: 204  len: 168 time: 0.2513440
Jun 01 10:08:29.433873 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-777c0f04-f43c-486b-af07-a41697862cda req-1773dd07-e381-455a-bddb-8a43ab62cd9f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:29.437007 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-777c0f04-f43c-486b-af07-a41697862cda req-1773dd07-e381-455a-bddb-8a43ab62cd9f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.1711526
Jun 01 10:08:29.482527 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-777c0f04-f43c-486b-af07-a41697862cda req-83900e47-5d92-464a-aa03-cab9de3dfe8d tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0402019
Jun 01 10:08:29.565557 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1057f489-faef-4271-985a-be6e34ca1453 req-df98bba3-c868-42f3-bc57-0bdca01dedfe tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:29.567034 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1057f489-faef-4271-985a-be6e34ca1453 req-df98bba3-c868-42f3-bc57-0bdca01dedfe tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 945 time: 0.0812516
Jun 01 10:08:29.665214 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1057f489-faef-4271-985a-be6e34ca1453 req-ba035ed7-882b-4718-aa07-21751f5eee5d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394115
Jun 01 10:08:30.188269 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6621ea16-58bb-4e72-9d6c-16e9aeedc665 req-4d98ec44-4063-4476-946f-e4623dd2dafb tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:30.189792 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6621ea16-58bb-4e72-9d6c-16e9aeedc665 req-4d98ec44-4063-4476-946f-e4623dd2dafb tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1466546
Jun 01 10:08:30.200428 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9035d45d-699b-4951-8ef8-b86361e4bb13 req-c5b066e9-4b8a-4dcd-912e-37f39e9d746f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:30.201842 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9035d45d-699b-4951-8ef8-b86361e4bb13 req-c5b066e9-4b8a-4dcd-912e-37f39e9d746f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1210048
Jun 01 10:08:30.275891 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6621ea16-58bb-4e72-9d6c-16e9aeedc665 req-c7e3fca0-e864-448b-bfb8-54ab10cd9a0a tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0730727
Jun 01 10:08:30.283392 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9035d45d-699b-4951-8ef8-b86361e4bb13 req-c6b756f5-f141-4e96-8bde-0ba3ae8e09cc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0658932
Jun 01 10:08:30.682512 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09a5ecd4-dcea-46c9-b637-ab12bfc16e64 req-10ffbe72-4582-4f79-b49a-52fb3710ea47 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:30.684991 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-09a5ecd4-dcea-46c9-b637-ab12bfc16e64 req-10ffbe72-4582-4f79-b49a-52fb3710ea47 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0926743
Jun 01 10:08:30.766242 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-09a5ecd4-dcea-46c9-b637-ab12bfc16e64 req-a85f879c-2ced-4478-b8b8-f8490c756240 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0744047
Jun 01 10:08:30.823256 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3291d94-a98a-48b8-a7f4-aac0f355d6ea req-33a1f402-fc7a-4fb0-bb65-4887fa77fd77 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:30.824809 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f3291d94-a98a-48b8-a7f4-aac0f355d6ea req-33a1f402-fc7a-4fb0-bb65-4887fa77fd77 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 945 time: 0.0937271
Jun 01 10:08:30.869673 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f3291d94-a98a-48b8-a7f4-aac0f355d6ea req-6543a28c-0ede-40ec-a337-ac77db487e34 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392165
Jun 01 10:08:31.512525 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cd42595-e6ec-4439-827b-b3b01eba3adc req-02d8eaeb-0e42-47ed-a437-517687370687 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:31.514219 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6cd42595-e6ec-4439-827b-b3b01eba3adc req-02d8eaeb-0e42-47ed-a437-517687370687 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.0972927
Jun 01 10:08:31.605523 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6cd42595-e6ec-4439-827b-b3b01eba3adc req-e66d80ce-a432-44c3-b5a1-f326781eb025 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0851915
Jun 01 10:08:31.644561 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37d24f96-00c0-4143-ab88-f46a5efeca75 req-c01a4726-ffd0-4e8c-98d5-a0c744be7397 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:31.646335 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-37d24f96-00c0-4143-ab88-f46a5efeca75 req-c01a4726-ffd0-4e8c-98d5-a0c744be7397 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1055255
Jun 01 10:08:31.694678 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-37d24f96-00c0-4143-ab88-f46a5efeca75 req-9b216721-51ce-43e2-b2a7-e06f22d58b14 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421672
Jun 01 10:08:31.966445 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbed8ac4-0783-4811-89d8-da27893d41d4 req-928e61c9-ac9f-4e90-b2c1-eafeb18309a1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:31.967906 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cbed8ac4-0783-4811-89d8-da27893d41d4 req-928e61c9-ac9f-4e90-b2c1-eafeb18309a1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0846968
Jun 01 10:08:32.014810 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cbed8ac4-0783-4811-89d8-da27893d41d4 req-5297caf9-b571-444b-b133-8e08c7e7e9c4 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0401213
Jun 01 10:08:32.797549 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-188c77d6-aa9c-4c97-bc59-a5d395ccfa19 req-3cd1cf28-05bc-4a20-9f39-10d0609e80d2 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:32.799044 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-188c77d6-aa9c-4c97-bc59-a5d395ccfa19 req-3cd1cf28-05bc-4a20-9f39-10d0609e80d2 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.0847976
Jun 01 10:08:32.891385 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-188c77d6-aa9c-4c97-bc59-a5d395ccfa19 req-c2a9276e-a80f-41c8-b9c3-779fb3fe9bd9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0580332
Jun 01 10:08:32.917436 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37fba680-c79b-4968-9797-8dee1b882211 req-7751770a-6244-418c-953d-b8a62e755637 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:32.918924 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-37fba680-c79b-4968-9797-8dee1b882211 req-7751770a-6244-418c-953d-b8a62e755637 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1163688
Jun 01 10:08:32.962726 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-37fba680-c79b-4968-9797-8dee1b882211 req-d9429581-c8ba-43d4-b6db-5548217e4d7a tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382528
Jun 01 10:08:33.204604 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37065c90-f059-4064-937a-6af11bdad331 req-3a017d45-edbb-45d6-9448-fd84645eed4b tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:33.206111 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-37065c90-f059-4064-937a-6af11bdad331 req-3a017d45-edbb-45d6-9448-fd84645eed4b tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0834219
Jun 01 10:08:33.250221 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-37065c90-f059-4064-937a-6af11bdad331 req-f4587260-7c07-4f77-88da-d54712042bce tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0384059
Jun 01 10:08:34.078342 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f6d954-2f68-4c10-8c88-9e0e191936ca req-b42a4937-8a2b-4d3c-a991-074e87879a37 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:34.079846 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f0f6d954-2f68-4c10-8c88-9e0e191936ca req-b42a4937-8a2b-4d3c-a991-074e87879a37 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.0794108
Jun 01 10:08:34.175536 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f0f6d954-2f68-4c10-8c88-9e0e191936ca req-1290b87e-63dd-4e75-a117-032ec4e482c2 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0607791
Jun 01 10:08:34.194871 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db766cb6-77be-47ae-b9fa-ce4ebd1fb3ab req-21b7e557-f790-4870-960d-cececa2c33bf tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:34.196454 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-db766cb6-77be-47ae-b9fa-ce4ebd1fb3ab req-21b7e557-f790-4870-960d-cececa2c33bf tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1157370
Jun 01 10:08:34.240155 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-db766cb6-77be-47ae-b9fa-ce4ebd1fb3ab req-695341ca-ef9e-42d2-93db-8cd06cfe0622 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0381348
Jun 01 10:08:34.440044 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e97faa4-ad83-4bb3-83c5-7279c18fa884 req-fbf37e14-cb7c-4059-8b70-fb4323a7b0ff tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:34.441491 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5e97faa4-ad83-4bb3-83c5-7279c18fa884 req-fbf37e14-cb7c-4059-8b70-fb4323a7b0ff tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0826955
Jun 01 10:08:34.486870 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5e97faa4-ad83-4bb3-83c5-7279c18fa884 req-110b7fc2-c465-4ec1-a043-4c9cc68d48d1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0389166
Jun 01 10:08:35.411506 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb78435e-a90f-423d-94b3-fb20d5afd675 req-a3256494-7b05-4538-89f0-d198579ef314 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:35.412977 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-eb78435e-a90f-423d-94b3-fb20d5afd675 req-a3256494-7b05-4538-89f0-d198579ef314 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1265028
Jun 01 10:08:35.471953 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-eb78435e-a90f-423d-94b3-fb20d5afd675 req-3be51cd1-8a34-4da7-a2cc-8e811085f520 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0522575
Jun 01 10:08:35.483630 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a58aa4c-1545-49ce-b22a-4998b44de079 req-59535ea5-fd6c-4975-9633-490ae3bd021d tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:35.485095 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7a58aa4c-1545-49ce-b22a-4998b44de079 req-59535ea5-fd6c-4975-9633-490ae3bd021d tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1319602
Jun 01 10:08:35.533090 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7a58aa4c-1545-49ce-b22a-4998b44de079 req-015d3f9c-caa9-4794-92f5-b81b834085ef tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418050
Jun 01 10:08:35.764279 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-585e556d-0d27-4f6d-bd74-01c029b1b1d4 req-433d160d-4857-4fce-b89e-7a63ead54ca9 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:35.765800 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-585e556d-0d27-4f6d-bd74-01c029b1b1d4 req-433d160d-4857-4fce-b89e-7a63ead54ca9 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.1716630
Jun 01 10:08:35.815117 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-585e556d-0d27-4f6d-bd74-01c029b1b1d4 req-41471eca-9165-44bd-ac24-7fa85b1019b0 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430455
Jun 01 10:08:36.277967 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6cff44e-21b8-41c1-9a3a-9f49a8584949 req-1ea1099a-d4e9-4a5f-8574-fb210641ea90 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:36.279487 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d6cff44e-21b8-41c1-9a3a-9f49a8584949 req-1ea1099a-d4e9-4a5f-8574-fb210641ea90 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 945 time: 0.0804415
Jun 01 10:08:36.324197 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d6cff44e-21b8-41c1-9a3a-9f49a8584949 req-17bd3691-20c6-4e3a-995a-7fc7303c0b87 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389338
Jun 01 10:08:36.730689 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c95ad207-0e81-47b8-8c67-729e91e6bb62 req-afdff143-3ba8-455d-ba97-446cfca8cf4f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:36.732343 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c95ad207-0e81-47b8-8c67-729e91e6bb62 req-afdff143-3ba8-455d-ba97-446cfca8cf4f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1433144
Jun 01 10:08:36.762124 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5bc7f6f-cba5-4646-abaa-0ad9b97a8192 req-ad890f42-9480-40ac-ae2c-b5139d675c7a tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:36.764548 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a5bc7f6f-cba5-4646-abaa-0ad9b97a8192 req-ad890f42-9480-40ac-ae2c-b5139d675c7a tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1195741
Jun 01 10:08:36.817975 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c95ad207-0e81-47b8-8c67-729e91e6bb62 req-92579117-bb55-4be4-bcd9-1cec4447c7b7 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0799313
Jun 01 10:08:36.827607 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a5bc7f6f-cba5-4646-abaa-0ad9b97a8192 req-1bdfc824-d0a9-480f-889a-458860cedc49 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0574322
Jun 01 10:08:36.996792 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b6bfad8-f426-45b5-ad2b-274db6d715d2 req-661564be-4eaa-4e1c-b8e8-ef7a0e4b0ebb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:36.998154 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5b6bfad8-f426-45b5-ad2b-274db6d715d2 req-661564be-4eaa-4e1c-b8e8-ef7a0e4b0ebb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0792990
Jun 01 10:08:37.042769 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5b6bfad8-f426-45b5-ad2b-274db6d715d2 req-2da1b507-532f-4b52-ae62-4924621ea795 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0387361
Jun 01 10:08:37.513264 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9cfa2f5-3425-4910-8d51-0d6f59ad211f req-1d29d64d-ce76-49ac-bd87-7f4629cc5b7a tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:37.514651 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d9cfa2f5-3425-4910-8d51-0d6f59ad211f req-1d29d64d-ce76-49ac-bd87-7f4629cc5b7a tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 945 time: 0.0858846
Jun 01 10:08:37.560213 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d9cfa2f5-3425-4910-8d51-0d6f59ad211f req-297fba4e-9c03-468c-8572-51aa53752bce tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397127
Jun 01 10:08:37.768602 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device ba4fa832-87bd-477b-bad8-2837ab09304a details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:08:37.909805 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port ba4fa832-87bd-477b-bad8-2837ab09304a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ba4fa832-87bd-477b-bad8-2837ab09304a,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:08:37.926014 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': 'ba4fa832-87bd-477b-bad8-2837ab09304a', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'port_id': 'ba4fa832-87bd-477b-bad8-2837ab09304a', 'mac_address': 'fa:16:3e:54:58:da', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 861, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:08:37.938479 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbd72dc4-2c05-4db7-883b-fc57b1aa5eba req-6c103740-6111-4f15-abf0-b679d4553e01 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:37.939987 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dbd72dc4-2c05-4db7-883b-fc57b1aa5eba req-6c103740-6111-4f15-abf0-b679d4553e01 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.30 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 945 time: 0.0956244
Jun 01 10:08:37.999616 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:38.016600 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id ba4fa832-87bd-477b-bad8-2837ab09304a {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:08:38.032041 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port ba4fa832-87bd-477b-bad8-2837ab09304a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ba4fa832-87bd-477b-bad8-2837ab09304a,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:08:38.096211 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:38.098967 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:38.173495 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=ba4fa832-87bd-477b-bad8-2837ab09304a,revision_number=6']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:38.176935 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:38.215314 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['ba4fa832-87bd-477b-bad8-2837ab09304a'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:08:38.215603 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07313873-3840-4ccf-9d35-3c81ab941ec1 req-16a06d61-8ba2-4d8f-91c6-6ffc8185f4bd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:38.217128 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-07313873-3840-4ccf-9d35-3c81ab941ec1 req-16a06d61-8ba2-4d8f-91c6-6ffc8185f4bd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.2220442
Jun 01 10:08:38.226598 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fafc25c1-c377-4755-855d-bd24ae846057 req-697537b6-ff48-4aa9-81a7-79388be47916 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:38.228636 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fafc25c1-c377-4755-855d-bd24ae846057 req-697537b6-ff48-4aa9-81a7-79388be47916 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1861103
Jun 01 10:08:38.296997 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-dbd72dc4-2c05-4db7-883b-fc57b1aa5eba req-d34ab0be-bf6a-445d-8fa7-21d8f105fd49 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Deleting port d9c3d5eb-478d-4614-b706-c3e6efb826e8 {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:08:38.297321 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-dbd72dc4-2c05-4db7-883b-fc57b1aa5eba req-d34ab0be-bf6a-445d-8fa7-21d8f105fd49 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:38.334384 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-07313873-3840-4ccf-9d35-3c81ab941ec1 req-a578a75f-37ca-4725-a1a0-7a95d270e0fb tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1047759
Jun 01 10:08:38.344771 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fafc25c1-c377-4755-855d-bd24ae846057 req-f5ce4d5d-b40f-489f-9fc7-ed7cb456640e tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1000876
Jun 01 10:08:38.576014 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-dbd72dc4-2c05-4db7-883b-fc57b1aa5eba req-d34ab0be-bf6a-445d-8fa7-21d8f105fd49 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] For port d9c3d5eb-478d-4614-b706-c3e6efb826e8, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=d9c3d5eb-478d-4614-b706-c3e6efb826e8,segment=NetworkSegment(a3eadacc-bc0f-438c-ba22-4e06ebfeec11),segment_id=a3eadacc-bc0f-438c-ba22-4e06ebfeec11)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:08:38.576371 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-dbd72dc4-2c05-4db7-883b-fc57b1aa5eba req-d34ab0be-bf6a-445d-8fa7-21d8f105fd49 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:38.724174 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-dbd72dc4-2c05-4db7-883b-fc57b1aa5eba req-d34ab0be-bf6a-445d-8fa7-21d8f105fd49 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Calling delete_port for d9c3d5eb-478d-4614-b706-c3e6efb826e8 owned by compute:nova {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:08:38.810136 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-444f1773-e655-4448-830f-225b22f04141 req-8561a092-b7a5-44f2-a8fd-6deda8008941 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:38.811542 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-444f1773-e655-4448-830f-225b22f04141 req-8561a092-b7a5-44f2-a8fd-6deda8008941 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.3000133
Jun 01 10:08:38.891894 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbcef7e9-c24c-4821-a601-2b74e24f3beb req-e62bbcc9-0233-4003-b0dc-3b4199b37063 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:38.893317 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cbcef7e9-c24c-4821-a601-2b74e24f3beb req-e62bbcc9-0233-4003-b0dc-3b4199b37063 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 945 time: 0.1782382
Jun 01 10:08:38.896644 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-444f1773-e655-4448-830f-225b22f04141 req-1165d645-6a76-49c1-a17c-7b9a38439bf2 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0742056
Jun 01 10:08:38.989612 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cbcef7e9-c24c-4821-a601-2b74e24f3beb req-042592f2-3df8-48ed-a0da-921a078ad3ee tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/security-groups?id=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0904634
Jun 01 10:08:39.086639 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-dbd72dc4-2c05-4db7-883b-fc57b1aa5eba req-d34ab0be-bf6a-445d-8fa7-21d8f105fd49 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:39.093013 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:39.100442 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['d9c3d5eb-478d-4614-b706-c3e6efb826e8'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:08:39.138436 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d34ab0be-bf6a-445d-8fa7-21d8f105fd49 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Pushing event deleted for resources: {'Port': ['ID=d9c3d5eb-478d-4614-b706-c3e6efb826e8,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:39.141676 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-d34ab0be-bf6a-445d-8fa7-21d8f105fd49 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:39.308476 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-dbd72dc4-2c05-4db7-883b-fc57b1aa5eba req-d34ab0be-bf6a-445d-8fa7-21d8f105fd49 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] No DVR routers for this DVR port d9c3d5eb-478d-4614-b706-c3e6efb826e8 on host hv-cinder-78726 {{(pid=92566) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:08:39.311464 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-dbd72dc4-2c05-4db7-883b-fc57b1aa5eba req-d34ab0be-bf6a-445d-8fa7-21d8f105fd49 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:39.314236 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd3c167b0-cbf0-47d4-a690-0a026d019228', 'name': 'network-vif-deleted', 'tag': 'd9c3d5eb-478d-4614-b706-c3e6efb826e8'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:08:39.321237 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-959a3028-d886-4f05-9a69-9801b8c0eb91" -d '{"events": [{"server_uuid": "d3c167b0-cbf0-47d4-a690-0a026d019228", "name": "network-vif-deleted", "tag": "d9c3d5eb-478d-4614-b706-c3e6efb826e8"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:08:39.359091 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:08:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-48be880d-9afc-45b1-979b-ac82a54a99f1 x-openstack-request-id: req-48be880d-9afc-45b1-979b-ac82a54a99f1 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:08:39.359679 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d3c167b0-cbf0-47d4-a690-0a026d019228", "name": "network-vif-deleted", "tag": "d9c3d5eb-478d-4614-b706-c3e6efb826e8", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:08:39.359958 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-48be880d-9afc-45b1-979b-ac82a54a99f1 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:08:39.360481 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd3c167b0-cbf0-47d4-a690-0a026d019228', 'name': 'network-vif-deleted', 'tag': 'd9c3d5eb-478d-4614-b706-c3e6efb826e8', 'status': 'completed', 'code': 200}
Jun 01 10:08:39.431634 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dbd72dc4-2c05-4db7-883b-fc57b1aa5eba req-d34ab0be-bf6a-445d-8fa7-21d8f105fd49 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.30 "DELETE /v2.0/ports/d9c3d5eb-478d-4614-b706-c3e6efb826e8 HTTP/1.1" status: 204  len: 173 time: 1.4843566
Jun 01 10:08:39.608487 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acacccf4-9c44-44fe-9acf-231c5cb1aa4a req-6d0514ee-7e19-4b7e-b1cb-d2110eb42108 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:39.609969 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-acacccf4-9c44-44fe-9acf-231c5cb1aa4a req-6d0514ee-7e19-4b7e-b1cb-d2110eb42108 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 945 time: 0.1530476
Jun 01 10:08:39.618453 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb4863cc-b703-43b8-8db7-7a585f6989c8 req-ccbcc531-50b2-4cdb-b5e6-7a24b6160cbc tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:39.620150 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cb4863cc-b703-43b8-8db7-7a585f6989c8 req-ccbcc531-50b2-4cdb-b5e6-7a24b6160cbc tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1297708
Jun 01 10:08:39.698996 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-acacccf4-9c44-44fe-9acf-231c5cb1aa4a req-47bca231-8e2f-4a5f-b32a-cad528cf9a7b tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0776513
Jun 01 10:08:39.724412 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cb4863cc-b703-43b8-8db7-7a585f6989c8 req-dcc5256e-2b2f-4e16-bd47-24d0f943b289 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0885327
Jun 01 10:08:39.786985 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device ba4fa832-87bd-477b-bad8-2837ab09304a up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:08:39.899819 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port ba4fa832-87bd-477b-bad8-2837ab09304a triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:08:39.900279 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:40.079131 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:40.148466 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '77032f84-7f38-4e7e-b0fd-accc20754797', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ba4fa832-87bd-477b-bad8-2837ab09304a'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:08:40.152257 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e2e9957d-e022-4869-b116-8697fc1a7ad2" -d '{"events": [{"server_uuid": "77032f84-7f38-4e7e-b0fd-accc20754797", "name": "network-vif-plugged", "status": "completed", "tag": "ba4fa832-87bd-477b-bad8-2837ab09304a"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:08:40.171490 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port ba4fa832-87bd-477b-bad8-2837ab09304a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ba4fa832-87bd-477b-bad8-2837ab09304a,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:08:40.179049 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d741a5e2-85e6-41fc-8823-4ab6d494d1a5 req-cf6c1eb4-531e-4f92-81c3-120ad278dffa tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:40.184853 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d741a5e2-85e6-41fc-8823-4ab6d494d1a5 req-cf6c1eb4-531e-4f92-81c3-120ad278dffa tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.1405210
Jun 01 10:08:40.246859 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:40.249034 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device d9c3d5eb-478d-4614-b706-c3e6efb826e8 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:08:40.296786 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:40.354390 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d741a5e2-85e6-41fc-8823-4ab6d494d1a5 req-3dad4954-cef2-4f6e-993a-19597190351c tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1579885
Jun 01 10:08:40.381126 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-e1cff88c-6806-43d6-9ae7-eb97c6bb0395 req-006af742-543c-47c2-97fc-0d106c4c9564 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Synchronizing usage tracker for tenant:bf05ff611bcf4202aee423d3ef734d15 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:08:40.442618 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: d9c3d5eb-478d-4614-b706-c3e6efb826e8 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:08:40.442876 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device d9c3d5eb-478d-4614-b706-c3e6efb826e8 not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:08:40.453177 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:08:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-efba3db8-901a-45ad-82cc-d0997224ca7e x-openstack-request-id: req-efba3db8-901a-45ad-82cc-d0997224ca7e {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:08:40.453643 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "77032f84-7f38-4e7e-b0fd-accc20754797", "name": "network-vif-plugged", "status": "completed", "tag": "ba4fa832-87bd-477b-bad8-2837ab09304a", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:08:40.453948 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-efba3db8-901a-45ad-82cc-d0997224ca7e {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:08:40.454442 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '77032f84-7f38-4e7e-b0fd-accc20754797', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ba4fa832-87bd-477b-bad8-2837ab09304a', 'code': 200}
Jun 01 10:08:40.492221 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=ba4fa832-87bd-477b-bad8-2837ab09304a,revision_number=7']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:40.499624 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:40.501675 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-e1cff88c-6806-43d6-9ae7-eb97c6bb0395 req-006af742-543c-47c2-97fc-0d106c4c9564 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Unset dirty status for tenant:bf05ff611bcf4202aee423d3ef734d15 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:08:40.503209 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e1cff88c-6806-43d6-9ae7-eb97c6bb0395 req-006af742-543c-47c2-97fc-0d106c4c9564 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] 10.222.0.68 "GET /v2.0/ports?device_id=d3c167b0-cbf0-47d4-a690-0a026d019228 HTTP/1.1" status: 200  len: 210 time: 0.2423337
Jun 01 10:08:40.553288 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8631a0bd-6063-4ac8-93c2-d2ea41cc42fb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:41.082631 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcc7dca9-cf05-438c-8f4f-07f0dc207499 req-c4ede8d7-2bbc-4619-967a-dd15c167ef20 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:41.084963 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fcc7dca9-cf05-438c-8f4f-07f0dc207499 req-c4ede8d7-2bbc-4619-967a-dd15c167ef20 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1504126
Jun 01 10:08:41.128743 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6ad10d0-35ff-45e2-9b93-d087b65a68e2 req-40152cb6-9052-4bda-9d8f-0a4f5c179240 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:41.130326 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e6ad10d0-35ff-45e2-9b93-d087b65a68e2 req-40152cb6-9052-4bda-9d8f-0a4f5c179240 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1443315
Jun 01 10:08:41.199623 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fcc7dca9-cf05-438c-8f4f-07f0dc207499 req-66dd5bd3-e7ba-4cf5-b98a-8ec6538303d5 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1045997
Jun 01 10:08:41.241845 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e6ad10d0-35ff-45e2-9b93-d087b65a68e2 req-c562f675-e7d4-4d1e-ab66-532aa15e66ec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0976431
Jun 01 10:08:41.815716 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-878f884f-ebf1-4d52-a80f-f6fde73d3983 req-54046880-cdee-4a61-83fb-7b85e8380674 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:41.815716 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-878f884f-ebf1-4d52-a80f-f6fde73d3983 req-54046880-cdee-4a61-83fb-7b85e8380674 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.3214433
Jun 01 10:08:41.847588 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60ac7db9-9e81-4fb4-a81c-c62e187000a3 req-64ab4e57-434e-4d08-bd41-a966dfabcd01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:41.849682 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-60ac7db9-9e81-4fb4-a81c-c62e187000a3 req-64ab4e57-434e-4d08-bd41-a966dfabcd01 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 1098 time: 0.2678490
Jun 01 10:08:41.950954 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-878f884f-ebf1-4d52-a80f-f6fde73d3983 req-61ccf7fc-0dfd-426b-a5e2-3ff15d926c45 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0638621
Jun 01 10:08:41.974467 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-60ac7db9-9e81-4fb4-a81c-c62e187000a3 req-8c89d772-1bfe-413f-b845-f3425f78b0a9 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1135571
Jun 01 10:08:42.527667 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f14d832b-ffbe-429a-bff6-3830e04a8472 req-2dedee91-88ab-4389-83ca-5c48f343a4b3 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:42.529325 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f14d832b-ffbe-429a-bff6-3830e04a8472 req-2dedee91-88ab-4389-83ca-5c48f343a4b3 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1654179
Jun 01 10:08:42.575854 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-992d22b9-7f3b-4f5e-9fa2-f65475216a8b req-9ff3b306-05fb-44cb-a304-2346da574667 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:42.577549 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-992d22b9-7f3b-4f5e-9fa2-f65475216a8b req-9ff3b306-05fb-44cb-a304-2346da574667 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1325359
Jun 01 10:08:42.641494 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f14d832b-ffbe-429a-bff6-3830e04a8472 req-6dfcee4d-c798-4734-a3f9-b348d231fda6 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0944569
Jun 01 10:08:42.653728 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-992d22b9-7f3b-4f5e-9fa2-f65475216a8b req-14502573-fd9d-490d-bdd3-fd19807a707a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0696266
Jun 01 10:08:43.080705 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-1b168c76-6eb5-4fe6-9461-c883a9712753 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:43.141934 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebc5b1a9-ec44-44f0-a17a-69cd6713b572 req-1e685475-d396-4b6f-9f7b-d0219b1ae5e8 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:43.143461 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ebc5b1a9-ec44-44f0-a17a-69cd6713b572 req-1e685475-d396-4b6f-9f7b-d0219b1ae5e8 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0851178
Jun 01 10:08:43.211317 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ebc5b1a9-ec44-44f0-a17a-69cd6713b572 req-63a8bcb9-d1a9-4c8b-86c6-d9aaaef9fdd2 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0615032
Jun 01 10:08:43.292988 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:43.938612 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea5a0bee-113b-4eeb-b8ff-3a7f152d63a3 req-d2fbc258-eb85-4d36-99ee-9fae37695e01 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:43.943488 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ea5a0bee-113b-4eeb-b8ff-3a7f152d63a3 req-d2fbc258-eb85-4d36-99ee-9fae37695e01 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1667304
Jun 01 10:08:43.970336 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f145201-0a16-4454-b64c-d1caff964904 req-12a7561e-2c00-45b5-b02a-58fee70771db tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:43.971895 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2f145201-0a16-4454-b64c-d1caff964904 req-12a7561e-2c00-45b5-b02a-58fee70771db tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1471417
Jun 01 10:08:44.027348 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ea5a0bee-113b-4eeb-b8ff-3a7f152d63a3 req-1f6626a1-1dfb-47d3-bd4e-9b353a3822cd tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0788727
Jun 01 10:08:44.046333 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:44.056097 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2f145201-0a16-4454-b64c-d1caff964904 req-2569711f-e208-4ed2-ad5a-9e91b207a592 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0770581
Jun 01 10:08:44.441016 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7925527c-23b5-40f3-9bd3-56bc6f7193bd req-6c0122cd-8dc1-4afe-98b1-7a38ece4ce53 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:44.450049 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7925527c-23b5-40f3-9bd3-56bc6f7193bd req-6c0122cd-8dc1-4afe-98b1-7a38ece4ce53 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.1073704
Jun 01 10:08:44.470935 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:08:44.516418 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7925527c-23b5-40f3-9bd3-56bc6f7193bd req-3a672edb-e853-4cd0-ae4e-767f1570aac4 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0599613
Jun 01 10:08:45.387047 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a958bb1f-aecc-40a8-a888-3239b50200b9 req-66cb30a7-616d-450b-954d-31e5eca74abe tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:45.388545 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a958bb1f-aecc-40a8-a888-3239b50200b9 req-66cb30a7-616d-450b-954d-31e5eca74abe tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.2046015
Jun 01 10:08:45.405605 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac0265ec-bd20-42ee-817f-5ac87e6771d4 req-0b879753-0c8a-49d2-afb7-1444a3acbafa tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:45.407459 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac0265ec-bd20-42ee-817f-5ac87e6771d4 req-0b879753-0c8a-49d2-afb7-1444a3acbafa tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1544631
Jun 01 10:08:45.495269 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a958bb1f-aecc-40a8-a888-3239b50200b9 req-90d3b21f-d91f-47ba-a397-221613a0c024 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1006424
Jun 01 10:08:45.508277 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac0265ec-bd20-42ee-817f-5ac87e6771d4 req-923cbadc-1517-4824-b1e8-d5596d6faf4a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0871015
Jun 01 10:08:45.708110 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48f7f590-ca2b-4b5c-a2a8-0f375e58bc3a req-0477221f-c7ef-45f5-9b06-05ecbb2b1b81 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:45.709597 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-48f7f590-ca2b-4b5c-a2a8-0f375e58bc3a req-0477221f-c7ef-45f5-9b06-05ecbb2b1b81 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0896952
Jun 01 10:08:45.758956 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:45.766453 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-48f7f590-ca2b-4b5c-a2a8-0f375e58bc3a req-01d1b445-0054-41a3-9d4f-74c7e230fd54 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425625
Jun 01 10:08:46.847285 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87d66067-2e95-4095-9189-61c3b0c3f554 req-7dec1c89-663c-4706-a90c-bf2657e4d097 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:46.848762 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87d66067-2e95-4095-9189-61c3b0c3f554 req-7dec1c89-663c-4706-a90c-bf2657e4d097 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.2325099
Jun 01 10:08:46.860518 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdbe812a-fb2f-4232-add7-d4b390772425 req-e47a7483-0df2-4619-ad8c-75cc28641042 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:46.861871 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cdbe812a-fb2f-4232-add7-d4b390772425 req-e47a7483-0df2-4619-ad8c-75cc28641042 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.2103286
Jun 01 10:08:46.930960 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87d66067-2e95-4095-9189-61c3b0c3f554 req-852f0590-4587-432f-8537-bc9220410bf6 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0681195
Jun 01 10:08:46.935329 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cdbe812a-fb2f-4232-add7-d4b390772425 req-570d946f-5494-45f7-8993-7b286d98bbfc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0580378
Jun 01 10:08:47.139954 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28786ad-cf95-4592-9ffe-47339c4ae416 req-8cf5c8d0-c857-4692-98bb-21b68ef19153 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:47.141775 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e28786ad-cf95-4592-9ffe-47339c4ae416 req-8cf5c8d0-c857-4692-98bb-21b68ef19153 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.1108675
Jun 01 10:08:47.199809 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e28786ad-cf95-4592-9ffe-47339c4ae416 req-a3ba289d-f085-44f9-b4ca-4721cfea4cce tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0516086
Jun 01 10:08:47.756313 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e652d73f-4630-44b5-903f-44bdb3cf5220 req-f981f375-00b5-49a6-a903-6a9694039382 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:47.758524 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e652d73f-4630-44b5-903f-44bdb3cf5220 req-f981f375-00b5-49a6-a903-6a9694039382 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1134365
Jun 01 10:08:47.810561 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e652d73f-4630-44b5-903f-44bdb3cf5220 req-699d0c77-f28b-4f5f-b1ad-069d2dd3460f tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0459328
Jun 01 10:08:48.173662 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1f0bd6c-6c74-4ca3-90fd-ba59a7a4b0df req-ac88830a-c68f-4240-a859-6ba8d9dc6f55 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:48.175150 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e1f0bd6c-6c74-4ca3-90fd-ba59a7a4b0df req-ac88830a-c68f-4240-a859-6ba8d9dc6f55 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1128886
Jun 01 10:08:48.250252 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e1f0bd6c-6c74-4ca3-90fd-ba59a7a4b0df req-2cf5cb4c-849f-478f-8b33-f10de1a57d8e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0625877
Jun 01 10:08:48.453750 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2728e3f-3d99-45d0-a388-5ba897607048 req-09838393-5960-46bb-9f54-5a4a25203d8f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:48.455728 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b2728e3f-3d99-45d0-a388-5ba897607048 req-09838393-5960-46bb-9f54-5a4a25203d8f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0872009
Jun 01 10:08:48.506968 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b2728e3f-3d99-45d0-a388-5ba897607048 req-bc22c60f-d0fd-4877-b346-3f1383c32d39 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0452099
Jun 01 10:08:49.025316 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d169c02-0576-4b16-b2f3-4bf7a75d7af6 req-92c8d48d-cb3f-49c3-accc-9f90e4846448 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:49.031391 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2d169c02-0576-4b16-b2f3-4bf7a75d7af6 req-92c8d48d-cb3f-49c3-accc-9f90e4846448 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1006873
Jun 01 10:08:49.077022 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2d169c02-0576-4b16-b2f3-4bf7a75d7af6 req-7b50062f-e0c1-4ff1-a72b-1624c1510dbb tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433819
Jun 01 10:08:49.196156 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c814fa7c-1798-48fd-9e4f-3543f9860d25 req-495154f5-6154-4317-9f76-8c44f799e9f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:49.197669 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c814fa7c-1798-48fd-9e4f-3543f9860d25 req-495154f5-6154-4317-9f76-8c44f799e9f4 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=ef4bc75ba53a44cca2e4b7c2b8aeb818&device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 1098 time: 0.0737646
Jun 01 10:08:49.357831 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c814fa7c-1798-48fd-9e4f-3543f9860d25 req-b9d4aea2-84e5-4698-83e1-03bc587a14c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:49.359497 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c814fa7c-1798-48fd-9e4f-3543f9860d25 req-b9d4aea2-84e5-4698-83e1-03bc587a14c8 service neutron] 10.222.0.30 "GET /v2.0/networks?id=34268ce8-8baf-41d5-acbc-1b6c167dd481 HTTP/1.1" status: 200  len: 920 time: 0.1540968
Jun 01 10:08:49.474794 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c814fa7c-1798-48fd-9e4f-3543f9860d25 req-6631f55d-7c5a-4021-80c7-14038daf7123 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=18b5c352-ee0c-425b-a1bf-666d362844b9 HTTP/1.1" status: 200  len: 217 time: 0.1045277
Jun 01 10:08:49.556609 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c814fa7c-1798-48fd-9e4f-3543f9860d25 req-4d1db1fd-15b1-4fda-a49f-0d9548528f38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:49.558039 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c814fa7c-1798-48fd-9e4f-3543f9860d25 req-4d1db1fd-15b1-4fda-a49f-0d9548528f38 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2ee54c26-f286-4f9a-b791-24aa84feb26a HTTP/1.1" status: 200  len: 859 time: 0.0739567
Jun 01 10:08:49.625032 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c814fa7c-1798-48fd-9e4f-3543f9860d25 req-b3e3be23-a483-4ca4-812d-50c713d96919 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=34268ce8-8baf-41d5-acbc-1b6c167dd481&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0568745
Jun 01 10:08:49.652048 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df73baf6-b66f-4ebc-b179-604f6e304bff req-03642a1f-23c3-4040-aa05-061a4999f2d9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:49.652048 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-df73baf6-b66f-4ebc-b179-604f6e304bff req-03642a1f-23c3-4040-aa05-061a4999f2d9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.2670054
Jun 01 10:08:49.865269 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-df73baf6-b66f-4ebc-b179-604f6e304bff req-c5a2ad8e-9885-4d77-aa65-929de2b2656d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2036557
Jun 01 10:08:49.916943 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c814fa7c-1798-48fd-9e4f-3543f9860d25 req-af74d4f3-910b-4f43-b72c-6b686c0d98ad service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2794836
Jun 01 10:08:49.934398 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f67001d9-2f40-4554-aaed-2d74c4146e09 req-9db0c03c-1b10-41ef-af21-7617b8da8a0e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:49.936132 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f67001d9-2f40-4554-aaed-2d74c4146e09 req-9db0c03c-1b10-41ef-af21-7617b8da8a0e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.2998688
Jun 01 10:08:50.135148 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f67001d9-2f40-4554-aaed-2d74c4146e09 req-df0602b8-5593-4ef3-a450-0a5f3dd4bb78 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1743469
Jun 01 10:08:50.195744 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c814fa7c-1798-48fd-9e4f-3543f9860d25 req-ca723a50-2b29-4c6b-9f62-d785de16150d service neutron] 10.222.0.30 "GET /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2585108
Jun 01 10:08:50.281055 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f4008db-9520-4fb6-af84-a5d833cdd2a4 req-33ec0161-6e7e-4ab5-bea2-b95815c4db57 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:50.282508 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4f4008db-9520-4fb6-af84-a5d833cdd2a4 req-33ec0161-6e7e-4ab5-bea2-b95815c4db57 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.0828323
Jun 01 10:08:50.330805 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4f4008db-9520-4fb6-af84-a5d833cdd2a4 req-4d1fe6ef-1571-4e66-9ce1-726883a0ec66 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0424039
Jun 01 10:08:51.444407 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1241c2f-ef5e-4950-a0fc-513e45474bde req-6cd782f4-0cb1-4c8f-b069-8bef8ecd12d2 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:51.446113 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c1241c2f-ef5e-4950-a0fc-513e45474bde req-6cd782f4-0cb1-4c8f-b069-8bef8ecd12d2 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.1230264
Jun 01 10:08:51.483380 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb20b17-5b47-4258-bc52-eae95277317c req-ab2ab434-d6c1-4bca-89fa-5cd1e54bb282 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:51.484545 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9eb20b17-5b47-4258-bc52-eae95277317c req-ab2ab434-d6c1-4bca-89fa-5cd1e54bb282 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.4104125
Jun 01 10:08:51.545929 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c1241c2f-ef5e-4950-a0fc-513e45474bde req-cac976f0-17ff-41cf-bf21-b07e6811237e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0941257
Jun 01 10:08:51.633309 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9eb20b17-5b47-4258-bc52-eae95277317c req-b4b0d71f-06e1-4ab8-b6cd-ac1c31ac5760 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1362257
Jun 01 10:08:51.857431 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd944f93-7742-459c-906a-aaee3a8acae2 req-79a65583-feee-4038-8ce6-84ce92aa2f38 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:51.859013 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dd944f93-7742-459c-906a-aaee3a8acae2 req-79a65583-feee-4038-8ce6-84ce92aa2f38 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1197004
Jun 01 10:08:51.952514 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dd944f93-7742-459c-906a-aaee3a8acae2 req-7484afe0-a466-4635-b680-de65cea9f037 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0851076
Jun 01 10:08:52.819060 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77bdf013-402a-412c-b9b6-023f2fdb909c req-4cc41f16-47ed-46f4-bfab-bb8be1b77ff5 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:52.820667 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-77bdf013-402a-412c-b9b6-023f2fdb909c req-4cc41f16-47ed-46f4-bfab-bb8be1b77ff5 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.1568844
Jun 01 10:08:52.826811 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac0eabbe-4280-417c-8a85-602b9a974348 req-48783ded-00d9-4c22-9dee-b1bbcf8732af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:52.828302 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac0eabbe-4280-417c-8a85-602b9a974348 req-48783ded-00d9-4c22-9dee-b1bbcf8732af service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=f4f6f875519045a39c1fdbadd53ce517&device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 1099 time: 0.1627531
Jun 01 10:08:52.985186 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-77bdf013-402a-412c-b9b6-023f2fdb909c req-805f5807-f3cf-43c3-b026-e9ae18792ac5 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1558628
Jun 01 10:08:53.111913 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df6d89f-bae1-4df1-bbf3-c8ab19cee9d4 req-6be77f40-f704-4d27-8c6c-7c86e8792ebf tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:53.114120 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9df6d89f-bae1-4df1-bbf3-c8ab19cee9d4 req-6be77f40-f704-4d27-8c6c-7c86e8792ebf tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.2712569
Jun 01 10:08:53.187122 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac0eabbe-4280-417c-8a85-602b9a974348 req-6718e38a-227e-48d6-9da1-02d3513ee6b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:53.189406 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac0eabbe-4280-417c-8a85-602b9a974348 req-6718e38a-227e-48d6-9da1-02d3513ee6b2 service neutron] 10.222.0.30 "GET /v2.0/networks?id=be546533-cf92-483d-9e38-7d14ca9c4902 HTTP/1.1" status: 200  len: 917 time: 0.3453059
Jun 01 10:08:53.338716 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9df6d89f-bae1-4df1-bbf3-c8ab19cee9d4 req-fd08a33e-4d37-4326-b5bd-605ef0c2d911 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2182813
Jun 01 10:08:53.366180 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac0eabbe-4280-417c-8a85-602b9a974348 req-59bfc7a2-2ab5-4947-a180-03f5d607945c service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ba4fa832-87bd-477b-bad8-2837ab09304a HTTP/1.1" status: 200  len: 1002 time: 0.1692643
Jun 01 10:08:53.423298 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e47bac1-cdfe-43e8-850c-218feb3be6c4 req-e01ab423-7e32-43c4-b0de-feb2d32facef tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:53.427360 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3e47bac1-cdfe-43e8-850c-218feb3be6c4 req-e01ab423-7e32-43c4-b0de-feb2d32facef tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.2864144
Jun 01 10:08:53.487031 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac0eabbe-4280-417c-8a85-602b9a974348 req-a0e0312f-f963-4be9-ac75-6ed42fce0335 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:53.489032 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac0eabbe-4280-417c-8a85-602b9a974348 req-a0e0312f-f963-4be9-ac75-6ed42fce0335 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=f2fdda64-a03c-41d7-8178-daca0363bd6e HTTP/1.1" status: 200  len: 855 time: 0.1154716
Jun 01 10:08:53.498696 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3e47bac1-cdfe-43e8-850c-218feb3be6c4 req-cc965591-5220-4b0d-b84d-6db3ac265490 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0637991
Jun 01 10:08:53.596138 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac0eabbe-4280-417c-8a85-602b9a974348 req-914bf937-00a4-4c2b-815b-87edaef6fcc2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:53.597677 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac0eabbe-4280-417c-8a85-602b9a974348 req-914bf937-00a4-4c2b-815b-87edaef6fcc2 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=be546533-cf92-483d-9e38-7d14ca9c4902&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0981593
Jun 01 10:08:53.763772 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac0eabbe-4280-417c-8a85-602b9a974348 req-1a8a1c2f-7dae-4c83-9669-67d9c74614af service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1581492
Jun 01 10:08:54.055351 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac0eabbe-4280-417c-8a85-602b9a974348 req-cdc767da-21c0-45c9-9e05-c7f330e4ef7d service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2839925
Jun 01 10:08:54.207192 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa5dbf47-0ebb-472e-be40-5bf866fcf854 req-fd25be27-3c83-4a89-9a44-a29e0cb1b776 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:54.209019 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-aa5dbf47-0ebb-472e-be40-5bf866fcf854 req-fd25be27-3c83-4a89-9a44-a29e0cb1b776 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0854673
Jun 01 10:08:54.256089 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-aa5dbf47-0ebb-472e-be40-5bf866fcf854 req-d16b21cf-7007-4582-9975-f9f73c92c7de tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0415103
Jun 01 10:08:54.544247 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed0c5468-f37e-4b8a-ac4f-0191bf12f203 req-d29fd17b-a63a-48e3-a6c9-4204b4d39613 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:54.545853 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ed0c5468-f37e-4b8a-ac4f-0191bf12f203 req-d29fd17b-a63a-48e3-a6c9-4204b4d39613 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.0862634
Jun 01 10:08:54.590079 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ed0c5468-f37e-4b8a-ac4f-0191bf12f203 req-76ada6fc-3889-44bd-82d3-9083d36e61b2 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0383558
Jun 01 10:08:55.448697 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7350c8b4-5aca-42b3-b499-2db71f4ab827 req-83568163-0755-4612-a8ee-d41ec439d62c tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:55.450164 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7350c8b4-5aca-42b3-b499-2db71f4ab827 req-83568163-0755-4612-a8ee-d41ec439d62c tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0812664
Jun 01 10:08:55.495036 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7350c8b4-5aca-42b3-b499-2db71f4ab827 req-ecd61a12-eee0-45cc-b5b2-1b65575768b7 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391474
Jun 01 10:08:55.853468 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eca0a46-f90b-470e-91ab-0cec48263737 req-23bfff57-023a-448b-9a01-3747cf3e7c1c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:55.854955 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6eca0a46-f90b-470e-91ab-0cec48263737 req-23bfff57-023a-448b-9a01-3747cf3e7c1c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 946 time: 0.1561866
Jun 01 10:08:55.899295 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6eca0a46-f90b-470e-91ab-0cec48263737 req-06dcac02-28d3-4b73-9672-b73aa81a1d02 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0385056
Jun 01 10:08:55.957992 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device ba4fa832-87bd-477b-bad8-2837ab09304a no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:08:56.079783 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:56.107332 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '77032f84-7f38-4e7e-b0fd-accc20754797', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'ba4fa832-87bd-477b-bad8-2837ab09304a'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:08:56.109644 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b665867c-4302-4424-98a8-18a757ad85b0" -d '{"events": [{"server_uuid": "77032f84-7f38-4e7e-b0fd-accc20754797", "name": "network-vif-unplugged", "status": "completed", "tag": "ba4fa832-87bd-477b-bad8-2837ab09304a"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:08:56.118631 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port ba4fa832-87bd-477b-bad8-2837ab09304a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ba4fa832-87bd-477b-bad8-2837ab09304a,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:08:56.136199 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:56.153746 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 01 Jun 2021 10:08:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-59ad2f4a-f0b3-4d74-8873-de6a6b1e0a34 x-openstack-request-id: req-59ad2f4a-f0b3-4d74-8873-de6a6b1e0a34 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:08:56.154058 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "77032f84-7f38-4e7e-b0fd-accc20754797", "name": "network-vif-unplugged", "status": "completed", "tag": "ba4fa832-87bd-477b-bad8-2837ab09304a", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:08:56.154322 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-59ad2f4a-f0b3-4d74-8873-de6a6b1e0a34 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:08:56.154715 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '77032f84-7f38-4e7e-b0fd-accc20754797', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'ba4fa832-87bd-477b-bad8-2837ab09304a', 'code': 200}
Jun 01 10:08:56.200367 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:08:56.202149 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-2527f620-2fea-4095-b430-2888995edd8d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:08:56.270402 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=ba4fa832-87bd-477b-bad8-2837ab09304a,revision_number=8']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:08:56.278165 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:56.278509 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:56.278842 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:56.279196 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:56.279522 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:56.279845 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:56.280162 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:56.280482 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:56.280817 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:56.281136 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:56.281448 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:56.281759 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:08:56.285807 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:08:56.682091 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc6dda0f-b620-47e8-9378-d7bd7df8522b req-7248765e-58cc-4722-aba7-3351cdb10a71 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:56.685356 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bc6dda0f-b620-47e8-9378-d7bd7df8522b req-7248765e-58cc-4722-aba7-3351cdb10a71 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0819585
Jun 01 10:08:56.729702 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bc6dda0f-b620-47e8-9378-d7bd7df8522b req-10ca6778-c30f-43d1-bc09-1c98161ddf5a tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0383654
Jun 01 10:08:57.108334 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-909e4bea-f3ea-49c1-993c-6b74d43b1c7e req-c98ff4d5-662b-477b-9c3e-9e60e416032c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:57.118681 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-909e4bea-f3ea-49c1-993c-6b74d43b1c7e req-c98ff4d5-662b-477b-9c3e-9e60e416032c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.1056550
Jun 01 10:08:57.171770 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-909e4bea-f3ea-49c1-993c-6b74d43b1c7e req-9490436e-0586-4816-b573-cb74e8e95638 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0518234
Jun 01 10:08:57.993819 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2852785e-908b-4693-bdcd-3e468299c0f2 req-01d04edc-a729-4e2c-ad3c-4832ca4baf5b tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:58.003976 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2852785e-908b-4693-bdcd-3e468299c0f2 req-01d04edc-a729-4e2c-ad3c-4832ca4baf5b tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.1552787
Jun 01 10:08:58.046690 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2852785e-908b-4693-bdcd-3e468299c0f2 req-f8b71438-a10c-4668-bed3-1f77634632c8 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0418448
Jun 01 10:08:58.422195 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-886796be-23b4-4469-8ebf-c6fcace24a90 req-8c20c6b1-4512-4a4f-ba25-ade973fb6af0 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:58.423895 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-886796be-23b4-4469-8ebf-c6fcace24a90 req-8c20c6b1-4512-4a4f-ba25-ade973fb6af0 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.1004786
Jun 01 10:08:58.478105 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-886796be-23b4-4469-8ebf-c6fcace24a90 req-748faed3-3dc5-4a41-a2be-777ac14b3c05 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0477257
Jun 01 10:08:58.871407 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e02bdbd-a467-4dde-8114-9f42c367ae55 req-14b5ddf7-9496-4ef6-93e8-22fe18240229 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:58.879600 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4e02bdbd-a467-4dde-8114-9f42c367ae55 req-14b5ddf7-9496-4ef6-93e8-22fe18240229 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.2672732
Jun 01 10:08:59.008890 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4e02bdbd-a467-4dde-8114-9f42c367ae55 req-8359c1ed-47e4-490a-93bd-5738c6232e03 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0749474
Jun 01 10:08:59.026896 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03d44819-e88a-46e6-8ac9-902e2ac7802d req-0170a42f-42db-4a63-9517-e4c297725970 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:59.028865 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-03d44819-e88a-46e6-8ac9-902e2ac7802d req-0170a42f-42db-4a63-9517-e4c297725970 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=d13dc1de700d428a8982ca87f11948d0&device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 1098 time: 0.1477046
Jun 01 10:08:59.192680 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03d44819-e88a-46e6-8ac9-902e2ac7802d req-4ad11173-c030-4d7d-afb1-3cdb857d2876 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:59.194624 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-03d44819-e88a-46e6-8ac9-902e2ac7802d req-4ad11173-c030-4d7d-afb1-3cdb857d2876 service neutron] 10.222.0.30 "GET /v2.0/networks?id=3d9ff4d3-b145-4108-a593-976a9cfb63dc HTTP/1.1" status: 200  len: 911 time: 0.1589973
Jun 01 10:08:59.373516 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-03d44819-e88a-46e6-8ac9-902e2ac7802d req-f2cf1119-ddd0-4c20-ae81-3ccbf3cd9c66 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 HTTP/1.1" status: 200  len: 1000 time: 0.1707819
Jun 01 10:08:59.449728 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03d44819-e88a-46e6-8ac9-902e2ac7802d req-7292cedf-015b-4318-8d12-bb190d200e26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:59.451258 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-03d44819-e88a-46e6-8ac9-902e2ac7802d req-7292cedf-015b-4318-8d12-bb190d200e26 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2a00a573-a4bb-4d2d-a3e6-7aef03966618 HTTP/1.1" status: 200  len: 849 time: 0.0698028
Jun 01 10:08:59.614419 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03d44819-e88a-46e6-8ac9-902e2ac7802d req-36632105-392d-496b-b46b-b570fd72fc29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:59.616502 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-03d44819-e88a-46e6-8ac9-902e2ac7802d req-36632105-392d-496b-b46b-b570fd72fc29 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=3d9ff4d3-b145-4108-a593-976a9cfb63dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1494195
Jun 01 10:08:59.905688 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-03d44819-e88a-46e6-8ac9-902e2ac7802d req-092e0996-b7de-4f9e-a55a-5aa54afb7df0 service neutron] 10.222.0.30 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2777843
Jun 01 10:08:59.919297 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f41daf-445f-4633-8081-7d24a1c2a76b req-f1df9eca-345c-4b9f-9bb4-f3807e4b56be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:08:59.921068 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-75f41daf-445f-4633-8081-7d24a1c2a76b req-f1df9eca-345c-4b9f-9bb4-f3807e4b56be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.2344763
Jun 01 10:09:00.073862 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-75f41daf-445f-4633-8081-7d24a1c2a76b req-54fe8825-09f0-448b-94c9-fb51c0edff19 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1284039
Jun 01 10:09:00.173220 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-03d44819-e88a-46e6-8ac9-902e2ac7802d req-0cff62f0-a5f5-4e97-b298-8e770d231706 service neutron] 10.222.0.30 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2509325
Jun 01 10:09:00.310459 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb8bb69-3980-47bc-996a-a22a6b3d2ccd req-8e00573f-bfee-43b6-8611-74ff2e103beb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:00.312118 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2fb8bb69-3980-47bc-996a-a22a6b3d2ccd req-8e00573f-bfee-43b6-8611-74ff2e103beb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0950096
Jun 01 10:09:00.343649 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 33470) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:00.370871 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2fb8bb69-3980-47bc-996a-a22a6b3d2ccd req-bdc44e9e-e4d1-42a6-a86d-5aa967a87481 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0523851
Jun 01 10:09:00.588599 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-de86292f-5250-406a-ba5c-cf342e4cfbd9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:00.634097 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-de86292f-5250-406a-ba5c-cf342e4cfbd9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:09:00.634097 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-de86292f-5250-406a-ba5c-cf342e4cfbd9 admin admin] Usage tracker for resource:security_group_rule and tenant:ce9260ea09f04bfd8b89f297d60527ff is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:09:00.636556 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-de86292f-5250-406a-ba5c-cf342e4cfbd9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:09:00.651399 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-de86292f-5250-406a-ba5c-cf342e4cfbd9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:09:00.771227 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-de86292f-5250-406a-ba5c-cf342e4cfbd9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:00.913088 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-de86292f-5250-406a-ba5c-cf342e4cfbd9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:00.922049 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-35c30835-9a61-44ed-a82c-a5e777a29f8c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:00.966395 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-de86292f-5250-406a-ba5c-cf342e4cfbd9 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=ce9260ea09f04bfd8b89f297d60527ff&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6215715
Jun 01 10:09:00.967490 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de86292f-5250-406a-ba5c-cf342e4cfbd9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9cc4587a-8b37-4e3d-9503-56fd7ec1bb76,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:00.969215 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 33488) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:00.970837 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-de86292f-5250-406a-ba5c-cf342e4cfbd9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:01.038759 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-45f789bd-5080-40a0-8872-96ec702e3b0b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:01.068226 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-45f789bd-5080-40a0-8872-96ec702e3b0b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:01.286813 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-45f789bd-5080-40a0-8872-96ec702e3b0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:01.292815 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:01.314710 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45f789bd-5080-40a0-8872-96ec702e3b0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9cc4587a-8b37-4e3d-9503-56fd7ec1bb76,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:01.325969 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-45f789bd-5080-40a0-8872-96ec702e3b0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:01.328467 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-45f789bd-5080-40a0-8872-96ec702e3b0b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:01.329712 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-45f789bd-5080-40a0-8872-96ec702e3b0b admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/9cc4587a-8b37-4e3d-9503-56fd7ec1bb76 HTTP/1.1" status: 204  len: 168 time: 0.3588808
Jun 01 10:09:01.669980 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-113ced3c-3d26-4302-8cd4-3a0341b23838 req-b5426df2-f89f-45b7-8a41-58c429fb1007 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:01.682714 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-113ced3c-3d26-4302-8cd4-3a0341b23838 req-b5426df2-f89f-45b7-8a41-58c429fb1007 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.1834598
Jun 01 10:09:01.741442 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-113ced3c-3d26-4302-8cd4-3a0341b23838 req-3477fd11-1c7b-4bc4-85ef-76ec6fe7886a tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0578473
Jun 01 10:09:02.795391 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d3a02b4-5c12-4bac-8cf8-34df3581ff7f req-783e6774-122d-4eb5-ae01-3b9abb50f59e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:02.798013 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7d3a02b4-5c12-4bac-8cf8-34df3581ff7f req-783e6774-122d-4eb5-ae01-3b9abb50f59e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.1095989
Jun 01 10:09:02.887712 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7d3a02b4-5c12-4bac-8cf8-34df3581ff7f req-4b62807b-4f15-44c2-9678-f43dad38279b tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0833139
Jun 01 10:09:02.972774 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 33560) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:03.020788 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25938859-271c-4786-951c-6742206488df req-49d0d7b0-1e4e-42bc-ad50-2feb76dbdc3f tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:03.028640 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-25938859-271c-4786-951c-6742206488df req-49d0d7b0-1e4e-42bc-ad50-2feb76dbdc3f tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.1382363
Jun 01 10:09:03.099402 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-25938859-271c-4786-951c-6742206488df req-ca6637ff-a4a3-430b-925a-a0fa445d7a16 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0695555
Jun 01 10:09:03.151877 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-439108916-network', 'tenant_id': '80c0fea786fd4fb9afd054ddb2559c2a'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:09:03.156682 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:09:03.161143 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Usage tracker for resource:network and tenant:80c0fea786fd4fb9afd054ddb2559c2a is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:09:03.164232 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:09:03.172185 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:09:03.240502 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Made reservation on behalf of 80c0fea786fd4fb9afd054ddb2559c2a for: {'network': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:09:03.243286 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:03.258707 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:03.274821 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:09:03.279555 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Usage tracker for resource:security_group_rule and tenant:80c0fea786fd4fb9afd054ddb2559c2a is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:09:03.282608 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:09:03.288717 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:09:03.389391 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:03.502170 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:03.505617 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8025f48f-1bb0-4eb7-8faa-9fd2cab3ec88 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:03.528963 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 898}  {{(pid=92565) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:09:03.553413 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:03.553907 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.segments_db [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Added segment f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793 of type vlan for network 3a2e5ab1-9bd9-4597-be91-953ea2afbf4b
Jun 01 10:09:03.567386 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7940912d-cf3a-47b8-92ad-b536ac1d0a04,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:03.583570 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:03.584162 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:03.584684 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:03.585235 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:03.585944 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:03.586711 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:03.587404 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:03.588033 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:03.588755 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:03.589797 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:03.590263 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:03.591010 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:03.597626 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:03.614772 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:03.639068 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 33582) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:03.713937 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:03.715674 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:03.716604 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:03.720117 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:03.817450 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-26994e4e-cdfb-4a5c-813b-a3ec2c68ccb6 req-5bfd435f-fe67-4bcc-97d6-486dfa1706bf service neutron] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1760242
Jun 01 10:09:03.852540 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Pushing event updated for resources: {'Network': ['ID=3a2e5ab1-9bd9-4597-be91-953ea2afbf4b,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:03.857288 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:03.865851 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network 3a2e5ab1-9bd9-4597-be91-953ea2afbf4b details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:09:03.925352 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 886 time: 0.9504740
Jun 01 10:09:03.929026 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 33594) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:03.938709 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] Request body: {'subnet': {'network_id': '3a2e5ab1-9bd9-4597-be91-953ea2afbf4b', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-439108916-subnet', 'tenant_id': '80c0fea786fd4fb9afd054ddb2559c2a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:09:03.955864 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:09:03.974008 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] Usage tracker for resource:subnet and tenant:80c0fea786fd4fb9afd054ddb2559c2a is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:09:04.004012 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device ba4fa832-87bd-477b-bad8-2837ab09304a no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:09:04.006329 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:09:04.014370 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:09:04.092395 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] Made reservation on behalf of 80c0fea786fd4fb9afd054ddb2559c2a for: {'subnet': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:09:04.095793 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3139364'] for subnet, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:04.312230 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eda64d1-63fd-418c-9f8b-797610d9a83c req-513d6913-b805-4a25-9ad3-b5672f19aa36 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:04.319715 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8eda64d1-63fd-418c-9f8b-797610d9a83c req-513d6913-b805-4a25-9ad3-b5672f19aa36 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.1636434
Jun 01 10:09:04.411769 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8eda64d1-63fd-418c-9f8b-797610d9a83c req-d820db38-42fe-4551-8a7f-566d7aa1a8dd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0908527
Jun 01 10:09:04.452144 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-633da9f9-5e61-4a61-b426-caa8c455375d req-6d0b8b25-1d7c-471e-a159-45f793e79960 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:04.455496 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-633da9f9-5e61-4a61-b426-caa8c455375d req-6d0b8b25-1d7c-471e-a159-45f793e79960 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.2196896
Jun 01 10:09:04.544326 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-633da9f9-5e61-4a61-b426-caa8c455375d req-462677a2-d631-422f-bf82-e3ce622e62a7 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0813315
Jun 01 10:09:04.670894 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2233128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3139378'] for subnet, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:04.675188 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:04.759307 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f256fe0c-ca2a-4bcd-87a4-40fba935858b,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:04.759307 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:04.775049 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] Checking segment: {'id': 'f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '3a2e5ab1-9bd9-4597-be91-953ea2afbf4b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92565) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:09:04.775524 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] Network hostable DHCP agents. Network: 3a2e5ab1-9bd9-4597-be91-953ea2afbf4b, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92565) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:09:04.944519 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] Network 3a2e5ab1-9bd9-4597-be91-953ea2afbf4b is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92565) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:09:05.060445 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, 3a2e5ab1-9bd9-4597-be91-953ea2afbf4b) {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:09:05.074767 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-126c1e87-1149-4276-8a18-8367305a9f4a None None] Network 3a2e5ab1-9bd9-4597-be91-953ea2afbf4b requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:09:05.083077 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:05.087024 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:05.185025 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 850 time: 1.2546716
Jun 01 10:09:05.414178 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87f06928-8600-4ded-ae98-20a595555d75 None None] Network 3a2e5ab1-9bd9-4597-be91-953ea2afbf4b requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:09:05.453291 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87e339e5-916e-4144-8b03-634604d3822a req-56ce3d2c-bbd1-4c24-b22c-c4e65e8e30af tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:05.455015 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87e339e5-916e-4144-8b03-634604d3822a req-56ce3d2c-bbd1-4c24-b22c-c4e65e8e30af tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.30 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.2244475
Jun 01 10:09:05.954794 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e08c858-2bb2-4a7c-870f-dd0e5ef21d67 req-219222f2-1bff-4736-b932-20407d4ba1a3 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:05.960570 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1e08c858-2bb2-4a7c-870f-dd0e5ef21d67 req-219222f2-1bff-4736-b932-20407d4ba1a3 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.4066703
Jun 01 10:09:05.964475 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-87e339e5-916e-4144-8b03-634604d3822a req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Deleting port ea668f76-dcbd-410c-a737-019b6396ac7f {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:09:05.966529 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-87e339e5-916e-4144-8b03-634604d3822a req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:06.000567 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6176a204-3d78-4c93-be32-992888178889 req-f32cadbb-c26e-421f-8e8c-268f247bf127 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:06.000567 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6176a204-3d78-4c93-be32-992888178889 req-f32cadbb-c26e-421f-8e8c-268f247bf127 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 946 time: 0.2591202
Jun 01 10:09:06.172644 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-87e339e5-916e-4144-8b03-634604d3822a req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] For port ea668f76-dcbd-410c-a737-019b6396ac7f, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ea668f76-dcbd-410c-a737-019b6396ac7f,segment=NetworkSegment(3982460c-82d6-48e1-a5bd-5d7cbbe910af),segment_id=3982460c-82d6-48e1-a5bd-5d7cbbe910af)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:09:06.173123 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-87e339e5-916e-4144-8b03-634604d3822a req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:06.336896 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1e08c858-2bb2-4a7c-870f-dd0e5ef21d67 req-07694728-096b-4aca-af7d-3e4f562f54d9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3539617
Jun 01 10:09:06.372799 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-87e339e5-916e-4144-8b03-634604d3822a req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Calling delete_port for ea668f76-dcbd-410c-a737-019b6396ac7f owned by compute:nova {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:09:06.387366 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6176a204-3d78-4c93-be32-992888178889 req-fb32b346-2a51-41ea-9e3d-917294aff4e8 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2716799
Jun 01 10:09:06.679197 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-87e339e5-916e-4144-8b03-634604d3822a req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:06.686858 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-326d0b5a-bb35-4eb0-8168-3638ba7a2947 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:06.697896 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['18b5c352-ee0c-425b-a1bf-666d362844b9', 'ea668f76-dcbd-410c-a737-019b6396ac7f'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:09:06.795885 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Pushing event deleted for resources: {'Port': ['ID=ea668f76-dcbd-410c-a737-019b6396ac7f,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:06.810606 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:06.810863 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:06.811381 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:06.811796 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:06.812461 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:06.813665 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:06.813665 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:06.813665 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:06.813892 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:06.814450 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:06.814714 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:06.815192 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:09:06.949926 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.263s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:06.954288 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-87e339e5-916e-4144-8b03-634604d3822a req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] No DVR routers for this DVR port ea668f76-dcbd-410c-a737-019b6396ac7f on host hv-cinder-78726 {{(pid=92566) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:09:06.959744 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-87e339e5-916e-4144-8b03-634604d3822a req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:06.970353 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c12e6393-ac9a-4707-a81b-f2c2c369c53a', 'name': 'network-vif-deleted', 'tag': 'ea668f76-dcbd-410c-a737-019b6396ac7f'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:09:06.978975 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d9c7fbd-14f3-41bb-be8d-a411a285a96d" -d '{"events": [{"server_uuid": "c12e6393-ac9a-4707-a81b-f2c2c369c53a", "name": "network-vif-deleted", "tag": "ea668f76-dcbd-410c-a737-019b6396ac7f"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:09:07.092218 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:09:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0b6303ae-ca8e-4850-9c26-14b525ab644f x-openstack-request-id: req-0b6303ae-ca8e-4850-9c26-14b525ab644f {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:09:07.096091 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c12e6393-ac9a-4707-a81b-f2c2c369c53a", "name": "network-vif-deleted", "tag": "ea668f76-dcbd-410c-a737-019b6396ac7f", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:09:07.102469 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-0b6303ae-ca8e-4850-9c26-14b525ab644f {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:09:07.102469 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c12e6393-ac9a-4707-a81b-f2c2c369c53a', 'name': 'network-vif-deleted', 'tag': 'ea668f76-dcbd-410c-a737-019b6396ac7f', 'status': 'completed', 'code': 200}
Jun 01 10:09:07.102469 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87e339e5-916e-4144-8b03-634604d3822a req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.30 "DELETE /v2.0/ports/ea668f76-dcbd-410c-a737-019b6396ac7f HTTP/1.1" status: 204  len: 173 time: 1.6374259
Jun 01 10:09:07.597007 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f961acd-8c2c-4894-bbe9-e1be8950a051 req-d04137d9-6904-425e-98c2-d8bf77d6182b tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:07.598500 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5f961acd-8c2c-4894-bbe9-e1be8950a051 req-d04137d9-6904-425e-98c2-d8bf77d6182b tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.1331553
Jun 01 10:09:07.626937 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-4bc8343e-dffc-478c-811b-f193f89417ee req-d5866fb9-b8c2-4c23-ad11-e0ab62e58f29 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Synchronizing usage tracker for tenant:ef4bc75ba53a44cca2e4b7c2b8aeb818 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:09:07.683469 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5f961acd-8c2c-4894-bbe9-e1be8950a051 req-93382742-85e8-48d5-ae17-9ff288594e83 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0781667
Jun 01 10:09:07.788991 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-4bc8343e-dffc-478c-811b-f193f89417ee req-d5866fb9-b8c2-4c23-ad11-e0ab62e58f29 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Unset dirty status for tenant:ef4bc75ba53a44cca2e4b7c2b8aeb818 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:09:07.794068 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4bc8343e-dffc-478c-811b-f193f89417ee req-d5866fb9-b8c2-4c23-ad11-e0ab62e58f29 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=c12e6393-ac9a-4707-a81b-f2c2c369c53a HTTP/1.1" status: 200  len: 210 time: 0.2325852
Jun 01 10:09:09.044188 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26994e4e-cdfb-4a5c-813b-a3ec2c68ccb6 req-1335c043-a0f1-4be4-8312-af64edee7095 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:09.045675 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-26994e4e-cdfb-4a5c-813b-a3ec2c68ccb6 req-1335c043-a0f1-4be4-8312-af64edee7095 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797&tenant_id=f4f6f875519045a39c1fdbadd53ce517 HTTP/1.1" status: 200  len: 1097 time: 0.1079798
Jun 01 10:09:09.053015 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c1578b0-f65c-41ca-b2e9-d155fe1aa550 req-956ad9c6-0420-4c44-a5b5-aa0de463c6de tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:09.054501 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4c1578b0-f65c-41ca-b2e9-d155fe1aa550 req-956ad9c6-0420-4c44-a5b5-aa0de463c6de tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.2309606
Jun 01 10:09:09.155977 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4c1578b0-f65c-41ca-b2e9-d155fe1aa550 req-764dcaf0-2965-4acf-9190-00b417777e5e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0917861
Jun 01 10:09:09.191674 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26994e4e-cdfb-4a5c-813b-a3ec2c68ccb6 req-8cdcbf57-e02d-4215-8f63-5e7729030b17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:09.194208 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-26994e4e-cdfb-4a5c-813b-a3ec2c68ccb6 req-8cdcbf57-e02d-4215-8f63-5e7729030b17 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=f4f6f875519045a39c1fdbadd53ce517&device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 1097 time: 0.1138813
Jun 01 10:09:09.379803 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26994e4e-cdfb-4a5c-813b-a3ec2c68ccb6 req-908bffd2-ca9f-4249-b3cb-ed386e869ab0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:09.379803 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-26994e4e-cdfb-4a5c-813b-a3ec2c68ccb6 req-908bffd2-ca9f-4249-b3cb-ed386e869ab0 service neutron] 10.222.0.30 "GET /v2.0/networks?id=be546533-cf92-483d-9e38-7d14ca9c4902 HTTP/1.1" status: 200  len: 917 time: 0.1715329
Jun 01 10:09:09.558945 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-26994e4e-cdfb-4a5c-813b-a3ec2c68ccb6 req-6a0eaff5-be62-41e9-8b7a-36b4e26a93d7 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ba4fa832-87bd-477b-bad8-2837ab09304a HTTP/1.1" status: 200  len: 1000 time: 0.1726813
Jun 01 10:09:09.668199 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26994e4e-cdfb-4a5c-813b-a3ec2c68ccb6 req-51a81f1e-e272-48eb-b94f-251466a661f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:09.669544 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-26994e4e-cdfb-4a5c-813b-a3ec2c68ccb6 req-51a81f1e-e272-48eb-b94f-251466a661f0 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=f2fdda64-a03c-41d7-8178-daca0363bd6e HTTP/1.1" status: 200  len: 855 time: 0.1066258
Jun 01 10:09:09.762251 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26994e4e-cdfb-4a5c-813b-a3ec2c68ccb6 req-d14880e9-2579-478e-a12f-62f79be9b7c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:09.764917 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-26994e4e-cdfb-4a5c-813b-a3ec2c68ccb6 req-d14880e9-2579-478e-a12f-62f79be9b7c9 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=be546533-cf92-483d-9e38-7d14ca9c4902&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0856776
Jun 01 10:09:09.906202 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device ea668f76-dcbd-410c-a737-019b6396ac7f no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:09:09.958854 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-26994e4e-cdfb-4a5c-813b-a3ec2c68ccb6 req-711f5240-bf47-4190-86a6-21c2c9a59072 service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1804917
Jun 01 10:09:09.973713 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: ea668f76-dcbd-410c-a737-019b6396ac7f {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:09:09.977333 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device ea668f76-dcbd-410c-a737-019b6396ac7f not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:09:10.150779 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-26994e4e-cdfb-4a5c-813b-a3ec2c68ccb6 req-565cc54f-3e23-44d2-ab1f-7087c2d56849 service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1836598
Jun 01 10:09:10.215826 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0481f219-ba38-4777-a594-dba537c6dd37 req-c03cb340-2d2b-4768-a7b7-a89232c0e602 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:10.223179 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0481f219-ba38-4777-a594-dba537c6dd37 req-c03cb340-2d2b-4768-a7b7-a89232c0e602 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.1091006
Jun 01 10:09:10.276995 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0481f219-ba38-4777-a594-dba537c6dd37 req-77f1bc73-18a1-48eb-9094-d2831aeb6832 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0528772
Jun 01 10:09:10.469379 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-2a324581-5fc9-48eb-9495-d092b58412b8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:10.473722 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82bb7175-f1e6-4718-8525-219abfb26c80 req-fc541c0d-8588-4aa5-83b7-540276f4734c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:10.475385 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-82bb7175-f1e6-4718-8525-219abfb26c80 req-fc541c0d-8588-4aa5-83b7-540276f4734c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.0923657
Jun 01 10:09:10.525579 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-82bb7175-f1e6-4718-8525-219abfb26c80 req-806caba9-ddc6-4e0d-b0ca-75c9136c54ef tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0419586
Jun 01 10:09:11.487029 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-656f73dd-c7a3-4b6c-8653-1c95146881e7 req-2d86e7a3-b7e5-42f9-ab6b-a63ad4e28c38 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:11.488891 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-656f73dd-c7a3-4b6c-8653-1c95146881e7 req-2d86e7a3-b7e5-42f9-ab6b-a63ad4e28c38 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.0979273
Jun 01 10:09:11.537651 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-656f73dd-c7a3-4b6c-8653-1c95146881e7 req-82525286-696a-464c-9835-0f15a1497aac tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0416365
Jun 01 10:09:11.759727 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5077a850-0327-4b73-bfbe-f1e541102432 req-39f413e7-a426-4857-9042-dffe179c6b71 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:11.761346 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5077a850-0327-4b73-bfbe-f1e541102432 req-39f413e7-a426-4857-9042-dffe179c6b71 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.0982709
Jun 01 10:09:11.815453 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5077a850-0327-4b73-bfbe-f1e541102432 req-d82b0c5f-5565-4961-ade2-8d2b4d0a2be3 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0464404
Jun 01 10:09:12.754187 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-191e6638-4ade-4c70-bfe0-2c9639299d89 req-3073214f-352d-4e94-9771-7ee83d71cbf6 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:12.755713 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-191e6638-4ade-4c70-bfe0-2c9639299d89 req-3073214f-352d-4e94-9771-7ee83d71cbf6 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.0940444
Jun 01 10:09:12.811845 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-191e6638-4ade-4c70-bfe0-2c9639299d89 req-ec0a134b-2dc2-4195-8e89-62dfb5b0054e tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0473676
Jun 01 10:09:12.970388 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-0c670f50-d9b9-4ac0-960e-50d743ce2602 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:13.020275 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a53088f8-c92b-4f9e-bdad-ad39262cb1e1 req-da83b3b4-e511-42c4-8a16-6bb9d5f42f0d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:13.021868 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a53088f8-c92b-4f9e-bdad-ad39262cb1e1 req-da83b3b4-e511-42c4-8a16-6bb9d5f42f0d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.0919123
Jun 01 10:09:13.068615 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a53088f8-c92b-4f9e-bdad-ad39262cb1e1 req-65cb89f1-80df-431d-81ff-dd2bc6cf0947 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0402746
Jun 01 10:09:13.217513 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:14.012332 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50db92dc-5ab3-459b-a408-75d270433c78 req-b4baf588-2107-40b1-b1e8-8630095d7e9c tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:14.015397 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-50db92dc-5ab3-459b-a408-75d270433c78 req-b4baf588-2107-40b1-b1e8-8630095d7e9c tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.0917370
Jun 01 10:09:14.042000 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:14.061325 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-50db92dc-5ab3-459b-a408-75d270433c78 req-fb9f949e-2ee7-4bf0-bfb3-e402764f5a0e tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418615
Jun 01 10:09:14.283794 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32c1fcd8-0c5a-4c99-bd00-06c476fcc2ea req-deafeef8-cae8-489e-b01f-d505521b9e55 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:14.285475 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-32c1fcd8-0c5a-4c99-bd00-06c476fcc2ea req-deafeef8-cae8-489e-b01f-d505521b9e55 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.0991626
Jun 01 10:09:14.427125 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-32c1fcd8-0c5a-4c99-bd00-06c476fcc2ea req-1caf76ab-4333-49a7-ad10-493ec1675b56 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1321445
Jun 01 10:09:15.263192 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b3e5e1f-1e1b-40d2-8bca-f4ac26cf6b06 req-e461ae03-fe82-4ea3-ad61-c2d69cdab15c tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:15.264833 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7b3e5e1f-1e1b-40d2-8bca-f4ac26cf6b06 req-e461ae03-fe82-4ea3-ad61-c2d69cdab15c tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.0829012
Jun 01 10:09:15.315021 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7b3e5e1f-1e1b-40d2-8bca-f4ac26cf6b06 req-34d2b638-0ea0-4366-8cdd-31c508f2b3e9 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438662
Jun 01 10:09:15.705254 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd4b0dbf-5ec6-4e5f-a65b-dc5e2d343bc9 req-c34ef64d-08da-4c60-af99-3ebe0d4d3e5d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:15.707211 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bd4b0dbf-5ec6-4e5f-a65b-dc5e2d343bc9 req-c34ef64d-08da-4c60-af99-3ebe0d4d3e5d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.1391687
Jun 01 10:09:15.762050 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bd4b0dbf-5ec6-4e5f-a65b-dc5e2d343bc9 req-fac8d0f5-5fdc-4393-a1bd-e08d2f7612d3 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0463891
Jun 01 10:09:15.783600 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:15.920763 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fec8f83c-8bcc-42b3-98a9-d825a02bff29 req-ced2acee-f017-4010-b0ea-241399dd5305 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:15.922117 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fec8f83c-8bcc-42b3-98a9-d825a02bff29 req-ced2acee-f017-4010-b0ea-241399dd5305 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.30 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.0820909
Jun 01 10:09:16.065927 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-fec8f83c-8bcc-42b3-98a9-d825a02bff29 req-b9ab98f2-2158-42d9-b737-920775ebf403 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Deleting port 18b5c352-ee0c-425b-a1bf-666d362844b9 {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:09:16.066278 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-fec8f83c-8bcc-42b3-98a9-d825a02bff29 req-b9ab98f2-2158-42d9-b737-920775ebf403 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:16.203280 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-fec8f83c-8bcc-42b3-98a9-d825a02bff29 req-b9ab98f2-2158-42d9-b737-920775ebf403 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] For port 18b5c352-ee0c-425b-a1bf-666d362844b9, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=18b5c352-ee0c-425b-a1bf-666d362844b9,segment=NetworkSegment(3982460c-82d6-48e1-a5bd-5d7cbbe910af),segment_id=3982460c-82d6-48e1-a5bd-5d7cbbe910af)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:09:16.203725 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-fec8f83c-8bcc-42b3-98a9-d825a02bff29 req-b9ab98f2-2158-42d9-b737-920775ebf403 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:16.330105 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-fec8f83c-8bcc-42b3-98a9-d825a02bff29 req-b9ab98f2-2158-42d9-b737-920775ebf403 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Calling delete_port for 18b5c352-ee0c-425b-a1bf-666d362844b9 owned by compute:nova {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:09:16.591479 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-ee1b6758-bc50-4c69-8ee0-056a3b692325 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:16.593502 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-ee1b6758-bc50-4c69-8ee0-056a3b692325 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/networks?id=3a2e5ab1-9bd9-4597-be91-953ea2afbf4b HTTP/1.1" status: 200  len: 813 time: 0.2404826
Jun 01 10:09:16.662200 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-fe41a85f-c7c3-4a4a-89f9-369c75bf535f tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/quotas/80c0fea786fd4fb9afd054ddb2559c2a HTTP/1.1" status: 200  len: 375 time: 0.0320926
Jun 01 10:09:16.672918 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9038fdb3-8d5e-4304-a598-eee98ad51546 req-e7aa0c3e-237e-4d25-8803-7cd232907a30 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:16.675781 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9038fdb3-8d5e-4304-a598-eee98ad51546 req-e7aa0c3e-237e-4d25-8803-7cd232907a30 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 945 time: 0.2297907
Jun 01 10:09:16.739553 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-9a874f2f-5dc3-48ad-a882-359898463e82 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=80c0fea786fd4fb9afd054ddb2559c2a&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0621288
Jun 01 10:09:16.786279 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9038fdb3-8d5e-4304-a598-eee98ad51546 req-ed746b9f-aa94-44b4-90a3-c9b75b59dc5e tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/security-groups?id=08fd5072-fefe-41fa-99a7-81ac5461f2b4&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0746498
Jun 01 10:09:16.843556 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-fec8f83c-8bcc-42b3-98a9-d825a02bff29 req-b9ab98f2-2158-42d9-b737-920775ebf403 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:16.859150 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-2c8294d1-d297-45c5-a046-77826269b1fb service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:16.859794 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['18b5c352-ee0c-425b-a1bf-666d362844b9'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:09:16.946950 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9ab98f2-2158-42d9-b737-920775ebf403 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Pushing event deleted for resources: {'Port': ['ID=18b5c352-ee0c-425b-a1bf-666d362844b9,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:16.980539 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b9ab98f2-2158-42d9-b737-920775ebf403 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:17.061177 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-fec8f83c-8bcc-42b3-98a9-d825a02bff29 req-b9ab98f2-2158-42d9-b737-920775ebf403 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] No DVR routers for this DVR port 18b5c352-ee0c-425b-a1bf-666d362844b9 on host hv-cinder-78726 {{(pid=92566) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:09:17.075605 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-fec8f83c-8bcc-42b3-98a9-d825a02bff29 req-b9ab98f2-2158-42d9-b737-920775ebf403 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:17.078109 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '28696956-78ff-4e48-8a25-b702828c16d5', 'name': 'network-vif-deleted', 'tag': '18b5c352-ee0c-425b-a1bf-666d362844b9'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:09:17.081049 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-344018d3-42bc-4021-954d-c9fc728034e7" -d '{"events": [{"server_uuid": "28696956-78ff-4e48-8a25-b702828c16d5", "name": "network-vif-deleted", "tag": "18b5c352-ee0c-425b-a1bf-666d362844b9"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:09:17.095770 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-f7bcaf15-80d4-41e5-b378-75beb62a8135 service neutron] 10.222.0.68 "GET /v2.0/networks/3a2e5ab1-9bd9-4597-be91-953ea2afbf4b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3414817
Jun 01 10:09:17.280671 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fec8f83c-8bcc-42b3-98a9-d825a02bff29 req-b9ab98f2-2158-42d9-b737-920775ebf403 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.30 "DELETE /v2.0/ports/18b5c352-ee0c-425b-a1bf-666d362844b9 HTTP/1.1" status: 204  len: 173 time: 1.3515837
Jun 01 10:09:17.313269 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43312b20-6315-4a1b-ab6c-833eb55cb2aa req-1c1882cf-2866-4002-ac7f-995f8d85f6ba tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:17.314747 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-43312b20-6315-4a1b-ab6c-833eb55cb2aa req-1c1882cf-2866-4002-ac7f-995f8d85f6ba tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.4165568
Jun 01 10:09:17.383639 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-aca019e6-b0fd-402b-84a0-faf408760ef2 service neutron] 10.222.0.68 "GET /v2.0/networks/3a2e5ab1-9bd9-4597-be91-953ea2afbf4b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2781894
Jun 01 10:09:17.404590 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-43312b20-6315-4a1b-ab6c-833eb55cb2aa req-c696cece-f4c9-4e18-acc9-ff6178b786c0 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0748463
Jun 01 10:09:17.545168 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:09:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9cf19585-0502-4f94-95d2-aa2752951309 x-openstack-request-id: req-9cf19585-0502-4f94-95d2-aa2752951309 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:09:17.545483 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "28696956-78ff-4e48-8a25-b702828c16d5", "name": "network-vif-deleted", "tag": "18b5c352-ee0c-425b-a1bf-666d362844b9", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:09:17.546148 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-9cf19585-0502-4f94-95d2-aa2752951309 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:09:17.546148 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '28696956-78ff-4e48-8a25-b702828c16d5', 'name': 'network-vif-deleted', 'tag': '18b5c352-ee0c-425b-a1bf-666d362844b9', 'status': 'completed', 'code': 200}
Jun 01 10:09:17.831695 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-77dfe716-7e56-4201-a3e0-d173a6fedaa3 req-dbd99ba5-aa8c-45eb-bb9f-cefc1fe7af78 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 210 time: 0.0869970
Jun 01 10:09:17.978588 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-ae3a21d0-d66c-4b5d-aca3-6015ebfd044b req-c6c90819-5b43-4828-8608-3781ae229b89 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Synchronizing usage tracker for tenant:ef4bc75ba53a44cca2e4b7c2b8aeb818 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:09:18.091055 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-ae3a21d0-d66c-4b5d-aca3-6015ebfd044b req-c6c90819-5b43-4828-8608-3781ae229b89 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Unset dirty status for tenant:ef4bc75ba53a44cca2e4b7c2b8aeb818 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:09:18.092294 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ae3a21d0-d66c-4b5d-aca3-6015ebfd044b req-c6c90819-5b43-4828-8608-3781ae229b89 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 210 time: 0.1696551
Jun 01 10:09:18.676287 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b04e6dd6-d1a4-4d17-af46-ed9b6d5240fc req-742d4260-809d-4170-a0f2-28b4289553a0 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:18.677806 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b04e6dd6-d1a4-4d17-af46-ed9b6d5240fc req-742d4260-809d-4170-a0f2-28b4289553a0 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.1109848
Jun 01 10:09:18.730597 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b04e6dd6-d1a4-4d17-af46-ed9b6d5240fc req-503afaa2-267b-49cb-8773-d88056db2184 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0447695
Jun 01 10:09:18.928344 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8efd10b0-3d40-44fe-84d3-194371c3666d req-896de14d-8920-48d8-9181-46ab869a2760 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 210 time: 0.0483849
Jun 01 10:09:19.260829 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b4b16304-8312-4f47-8e9e-fcfb77c3d119 req-454128ed-afb1-4fe0-a0eb-64e47f0a89c7 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 210 time: 0.0465808
Jun 01 10:09:19.933827 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a899914-048e-4683-b35c-dfcc93d76fa5 req-e862fbe9-f965-4050-8cb1-cd81cf31634a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:19.935330 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1a899914-048e-4683-b35c-dfcc93d76fa5 req-e862fbe9-f965-4050-8cb1-cd81cf31634a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.0875862
Jun 01 10:09:19.982168 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 18b5c352-ee0c-425b-a1bf-666d362844b9 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:09:19.992072 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1a899914-048e-4683-b35c-dfcc93d76fa5 req-356cb0d5-063d-4f6b-853b-cdd83fc77167 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0502880
Jun 01 10:09:20.053548 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: 18b5c352-ee0c-425b-a1bf-666d362844b9 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:09:20.054046 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 18b5c352-ee0c-425b-a1bf-666d362844b9 not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:09:20.092037 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c9fab79b-2ba3-4754-bd6a-e508f3b956e6 req-a676a8ce-750d-458f-9a17-f88a0f770562 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 210 time: 0.0457957
Jun 01 10:09:20.427686 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-af993b8d-3253-40b4-beed-a83c2c3ede1c req-b2f12280-60c1-4213-b8b8-3f9dc327f5d6 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 210 time: 0.0451782
Jun 01 10:09:21.256706 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bb519e8c-4fc3-4d48-97e2-117b75838b03 req-b2696c73-4bf9-42f8-bea0-d49f0da069fd tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 210 time: 0.0512421
Jun 01 10:09:21.409441 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c834d4b-1860-4180-a38f-ea4aca3d317a req-0ad113b9-2768-4dbd-acea-3a9521bf8593 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:21.410879 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6c834d4b-1860-4180-a38f-ea4aca3d317a req-0ad113b9-2768-4dbd-acea-3a9521bf8593 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.1027761
Jun 01 10:09:21.461549 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6c834d4b-1860-4180-a38f-ea4aca3d317a req-782ac291-f521-497a-a75d-8c90d79ec262 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0449648
Jun 01 10:09:21.471258 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:09:21.586390 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8b983a61-a617-416c-b14d-3a229663ec1d req-cf3aacf4-6a82-44bd-9c9e-c5b9ff231308 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 210 time: 0.0498033
Jun 01 10:09:22.431165 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dc125ab8-2007-4d5e-b619-412386c937b2 req-f0d3a9b0-8747-45ee-9daa-137686780e8a tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 210 time: 0.0426743
Jun 01 10:09:22.664802 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7faaf37-5778-4fae-a589-8b65bbfe3ddf req-59ec6fa1-b95f-42af-8eaa-4d74d07bfe3c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:22.666255 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b7faaf37-5778-4fae-a589-8b65bbfe3ddf req-59ec6fa1-b95f-42af-8eaa-4d74d07bfe3c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.0834608
Jun 01 10:09:22.753043 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b7faaf37-5778-4fae-a589-8b65bbfe3ddf req-5c00f745-64b1-4eaa-bf84-9005aaa825e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0805809
Jun 01 10:09:22.755310 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3994f426-d700-44f6-aa64-604dbdb9657a req-6a9b0f5a-380c-4a21-982a-29b0219e4b92 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 210 time: 0.0553548
Jun 01 10:09:23.728913 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-88467858-49a3-4ad1-bcd0-6cb768767365 req-46dc78cf-0b65-4e10-a379-97878f68a463 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 210 time: 0.0444477
Jun 01 10:09:23.976010 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-593835f8-975b-40b8-89f5-ed7c32946dd1 req-8c94bb4b-77c9-4183-9fe3-9cf17d57ba57 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 210 time: 0.0544329
Jun 01 10:09:24.019556 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f4bf34f-6dab-40e1-921a-d5fa728f40ff req-4dd71338-568f-4db5-a0be-2fcbe573c8c2 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:24.020997 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3f4bf34f-6dab-40e1-921a-d5fa728f40ff req-4dd71338-568f-4db5-a0be-2fcbe573c8c2 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.1317554
Jun 01 10:09:24.067843 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3f4bf34f-6dab-40e1-921a-d5fa728f40ff req-d95354b6-3743-4900-99d0-7821927fd859 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0408113
Jun 01 10:09:24.865905 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa41b846-d554-4d77-bcbd-516b49c40d8c req-d2e920ab-17d4-48b7-9527-8f9952150a35 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 210 time: 0.0444939
Jun 01 10:09:25.211492 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8c1be81d-8845-4dd4-9400-002871178eeb req-fa68f2b9-2faf-42e0-8928-71d14ae53459 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 210 time: 0.0601101
Jun 01 10:09:25.295051 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28c7112f-d504-4bd8-aaf9-9d20102c4d81 req-5fc383fe-c3d3-48cd-aabe-736cd2e280b9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:25.296496 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-28c7112f-d504-4bd8-aaf9-9d20102c4d81 req-5fc383fe-c3d3-48cd-aabe-736cd2e280b9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.0840738
Jun 01 10:09:25.358890 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-28c7112f-d504-4bd8-aaf9-9d20102c4d81 req-6fffe2a0-9400-4249-823b-9778c6917445 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0544279
Jun 01 10:09:25.470000 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 33946) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:25.542095 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_v2 [None req-1bc48c4e-56d2-4c3a-bc70-eecb5b338383 admin admin] Deleting subnet f2cbb504-b9e2-47fc-88fd-eb43b0f783c6 {{(pid=92565) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 10:09:25.545099 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1bc48c4e-56d2-4c3a-bc70-eecb5b338383 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:25.594871 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1bc48c4e-56d2-4c3a-bc70-eecb5b338383 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2998467'] for subnet, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:25.648809 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1bc48c4e-56d2-4c3a-bc70-eecb5b338383 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7791835'] for subnet, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:26.024216 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3f974b17-3bdc-40bd-9bda-859d57450f0b req-65a71bb8-b900-487f-b835-1f8d5a34cf47 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 210 time: 0.0490327
Jun 01 10:09:26.280259 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1bc48c4e-56d2-4c3a-bc70-eecb5b338383 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7793006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2233195', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3139387'] for subnet, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:26.299221 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:26.303916 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:26.357189 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1bc48c4e-56d2-4c3a-bc70-eecb5b338383 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:26.370384 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bc48c4e-56d2-4c3a-bc70-eecb5b338383 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f2cbb504-b9e2-47fc-88fd-eb43b0f783c6,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:26.375089 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-1bc48c4e-56d2-4c3a-bc70-eecb5b338383 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:26.377873 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-1bc48c4e-56d2-4c3a-bc70-eecb5b338383 admin admin] 10.222.0.68 "DELETE /v2.0/subnets/f2cbb504-b9e2-47fc-88fd-eb43b0f783c6 HTTP/1.1" status: 204  len: 168 time: 0.9066844
Jun 01 10:09:26.380438 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 33954) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:26.529973 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a197c96b-a255-4484-b274-761dac353cb7 req-d4de4b2e-0454-447d-af42-66e415586c3b tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 210 time: 0.1361492
Jun 01 10:09:26.561773 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-752cee08-a5b4-4f45-9741-40fe5e88159b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7813807'] for network, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:26.662958 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a1be77-1a87-4ddb-a7b0-caaef02c42b3 req-0d3e55ef-8e90-4412-bd14-3e9a878df049 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:26.662958 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-71a1be77-1a87-4ddb-a7b0-caaef02c42b3 req-0d3e55ef-8e90-4412-bd14-3e9a878df049 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.0835583
Jun 01 10:09:26.702085 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-752cee08-a5b4-4f45-9741-40fe5e88159b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7795028', 'neutron.services.segments.db._delete_segments_for_network-8726958294492'] for network, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:26.717168 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-752cee08-a5b4-4f45-9741-40fe5e88159b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7efe7109ed30>,) {'filters': {'network_id': ['3794c3e5-fe1f-49fc-8746-7fe7f2154093']}} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:09:26.737019 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-752cee08-a5b4-4f45-9741-40fe5e88159b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7efe7109ed30>, 'a3eadacc-bc0f-438c-ba22-4e06ebfeec11') {'for_net_delete': True} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:09:26.737481 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-752cee08-a5b4-4f45-9741-40fe5e88159b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7efe7109ed30>, 'a3eadacc-bc0f-438c-ba22-4e06ebfeec11') {} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:09:26.752574 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-752cee08-a5b4-4f45-9741-40fe5e88159b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726958303133', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2998472'] for segment, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:26.757257 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-71a1be77-1a87-4ddb-a7b0-caaef02c42b3 req-3863de29-485a-4162-a554-760e30bba104 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0876799
Jun 01 10:09:26.771178 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-752cee08-a5b4-4f45-9741-40fe5e88159b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:26.778612 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-752cee08-a5b4-4f45-9741-40fe5e88159b admin admin] Releasing vlan 884 on physical network physnet1 to pool {{(pid=92565) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 10:09:26.779098 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-752cee08-a5b4-4f45-9741-40fe5e88159b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2295757'] for segment, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]: Traceback (most recent call last):
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:     timer()
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:     cb(*args, **kw)
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:     return func(*args, **kwargs)
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:     self._notify()
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:     self.callback(batched_events)
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:     event.method(event)
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:     return f(self, *a, **k)
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._get(url).json()
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self.request(url, 'GET', **kwargs)
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 10:09:26.792235 dv-cinder-787262-4-iscsi neutron-server[92565]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 10:09:26.941915 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-752cee08-a5b4-4f45-9741-40fe5e88159b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7795037', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-403638'] for network, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:26.946332 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-752cee08-a5b4-4f45-9741-40fe5e88159b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:26.953803 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-bb322e25-04f0-469f-a6da-96c947e2c90d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:26.977095 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-752cee08-a5b4-4f45-9741-40fe5e88159b admin admin] Pushing event deleted for resources: {'Network': ['ID=3794c3e5-fe1f-49fc-8746-7fe7f2154093,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:26.980206 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-752cee08-a5b4-4f45-9741-40fe5e88159b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:27.039688 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-752cee08-a5b4-4f45-9741-40fe5e88159b admin admin] 10.222.0.68 "DELETE /v2.0/networks/3794c3e5-fe1f-49fc-8746-7fe7f2154093 HTTP/1.1" status: 204  len: 168 time: 0.6578727
Jun 01 10:09:27.172239 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-afda334e-b3e1-4adc-990a-7a76023d283c req-ee6591cd-c698-4d16-a3e2-1521998e2e33 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 210 time: 0.0449994
Jun 01 10:09:27.352690 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 33966) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:27.401063 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-ba1a6f1f-ecc7-4df2-9f98-56ab95ddcfcb admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=bf05ff611bcf4202aee423d3ef734d15&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0465870
Jun 01 10:09:27.403424 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 33970) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:27.467507 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f373b84d-9171-4c2f-98fc-f6df3b931242 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:27.497932 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f373b84d-9171-4c2f-98fc-f6df3b931242 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:27.635453 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f373b84d-9171-4c2f-98fc-f6df3b931242 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:27.640763 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8d1f187e-8296-413b-9c22-eecf89cccf8d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:27.658883 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f373b84d-9171-4c2f-98fc-f6df3b931242 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d7ba0ac-8c05-44b1-b115-7ce7d26a4033,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:27.667591 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f373b84d-9171-4c2f-98fc-f6df3b931242 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:27.738035 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-024c9a68-8b25-4c15-81fe-38cded6f733e req-50c1e573-efac-4c65-a2a3-f64b1681b90f tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 210 time: 0.0599451
Jun 01 10:09:27.788173 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f373b84d-9171-4c2f-98fc-f6df3b931242 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:27.789363 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-f373b84d-9171-4c2f-98fc-f6df3b931242 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/6d7ba0ac-8c05-44b1-b115-7ce7d26a4033 HTTP/1.1" status: 204  len: 168 time: 0.3849323
Jun 01 10:09:28.056758 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d8e3c7f-b15c-4342-a72c-ec9c48594bb4 req-b6640874-3c76-4254-95e0-4eff03e501fc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:28.058402 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5d8e3c7f-b15c-4342-a72c-ec9c48594bb4 req-b6640874-3c76-4254-95e0-4eff03e501fc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.1609471
Jun 01 10:09:28.105046 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5d8e3c7f-b15c-4342-a72c-ec9c48594bb4 req-345fc37d-8e40-4a81-9c5c-13a3f9915da3 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405548
Jun 01 10:09:28.340192 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3ba85148-8d81-41e2-bbd6-1856278a6b70 req-50a59075-20b7-47cd-b122-70e558485bce tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 210 time: 0.0509257
Jun 01 10:09:28.908088 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e53cdf4f-77aa-4723-aaf5-da1acf6bb81e req-4ea11c7a-7835-4dc7-8ac4-36d325be1961 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 210 time: 0.0474222
Jun 01 10:09:29.316005 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8cf0ec6-2452-4380-bffe-bccc7be6fefe req-316c8f23-a24c-4310-b278-616d6d23d90c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:29.317702 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c8cf0ec6-2452-4380-bffe-bccc7be6fefe req-316c8f23-a24c-4310-b278-616d6d23d90c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.0852356
Jun 01 10:09:29.369533 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c8cf0ec6-2452-4380-bffe-bccc7be6fefe req-c96a809f-ba37-4313-b3d4-07fe4d785726 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0461640
Jun 01 10:09:29.499288 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b6ff4b2c-48aa-4791-872e-4ac629e0eeea req-72bf7a1b-e981-45a8-b83c-0182d969eaef tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 210 time: 0.0432975
Jun 01 10:09:30.135822 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1bc6afac-2eec-4bde-961f-9600b214b75d req-74694fde-8893-4be6-a37d-e2e8d9e4051f tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 210 time: 0.0764759
Jun 01 10:09:30.155763 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-335fedf2-1620-4ed1-bb36-11bc0f4ea050 req-bcc0ac40-90ce-4cce-9a30-4e56fed457db service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1552515
Jun 01 10:09:30.253581 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-335fedf2-1620-4ed1-bb36-11bc0f4ea050 req-2dbe5e16-0cce-43a2-8de1-03ddf054b437 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:30.255084 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-335fedf2-1620-4ed1-bb36-11bc0f4ea050 req-2dbe5e16-0cce-43a2-8de1-03ddf054b437 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=d13dc1de700d428a8982ca87f11948d0&device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 1098 time: 0.0740135
Jun 01 10:09:30.414512 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-335fedf2-1620-4ed1-bb36-11bc0f4ea050 req-648a17aa-f276-4b3b-acc0-31cc78b4dee1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:30.416726 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-335fedf2-1620-4ed1-bb36-11bc0f4ea050 req-648a17aa-f276-4b3b-acc0-31cc78b4dee1 service neutron] 10.222.0.30 "GET /v2.0/networks?id=3d9ff4d3-b145-4108-a593-976a9cfb63dc HTTP/1.1" status: 200  len: 911 time: 0.1397479
Jun 01 10:09:30.610406 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-335fedf2-1620-4ed1-bb36-11bc0f4ea050 req-1d9802b7-8a7d-4ffd-ac3b-445269569a80 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 HTTP/1.1" status: 200  len: 1000 time: 0.1814725
Jun 01 10:09:30.695019 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34653a6f-f820-4d8f-97fc-e0fe8b4ff4ad req-409109cc-d8ca-4aed-9d42-f50351467368 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 210 time: 0.0832601
Jun 01 10:09:30.723607 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a5f8d45-dd3d-4e05-a39b-1c5fabb09998 req-2186394f-78e5-46d8-8b0a-dbdd1fb809e4 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:30.725011 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6a5f8d45-dd3d-4e05-a39b-1c5fabb09998 req-2186394f-78e5-46d8-8b0a-dbdd1fb809e4 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.2144923
Jun 01 10:09:30.733985 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-335fedf2-1620-4ed1-bb36-11bc0f4ea050 req-0960ef45-5658-434a-8533-913a200002c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:30.735443 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-335fedf2-1620-4ed1-bb36-11bc0f4ea050 req-0960ef45-5658-434a-8533-913a200002c8 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2a00a573-a4bb-4d2d-a3e6-7aef03966618 HTTP/1.1" status: 200  len: 849 time: 0.0868964
Jun 01 10:09:30.829029 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6a5f8d45-dd3d-4e05-a39b-1c5fabb09998 req-80b12c12-abff-4f3a-88e7-48d8168b8a44 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0968490
Jun 01 10:09:30.848525 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-335fedf2-1620-4ed1-bb36-11bc0f4ea050 req-4a2958a7-3d00-4fd5-b52c-c3606512c5ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:30.848525 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-335fedf2-1620-4ed1-bb36-11bc0f4ea050 req-4a2958a7-3d00-4fd5-b52c-c3606512c5ea service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=3d9ff4d3-b145-4108-a593-976a9cfb63dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0975945
Jun 01 10:09:30.996069 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-335fedf2-1620-4ed1-bb36-11bc0f4ea050 req-034d71bd-964f-43a0-b763-498e9c2e8b8c service neutron] 10.222.0.30 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1416194
Jun 01 10:09:31.156948 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-335fedf2-1620-4ed1-bb36-11bc0f4ea050 req-ca19f825-b45f-43be-bd13-216abc3fbabe service neutron] 10.222.0.30 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1509380
Jun 01 10:09:31.336036 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1c59812-55eb-41fe-9390-66a0751206c3 req-6f2578a9-3f4c-436e-bc46-edfd6782d5bc tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] 10.222.0.68 "GET /v2.0/ports?device_id=28696956-78ff-4e48-8a25-b702828c16d5 HTTP/1.1" status: 200  len: 210 time: 0.0467300
Jun 01 10:09:31.848895 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0b1619ca-fe69-4da3-89bf-ad69b99264af req-164c1f40-023f-4cb1-b1c3-88eea58f2878 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 210 time: 0.0448270
Jun 01 10:09:32.207388 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-6d77ad13-dec9-49aa-a37a-ee80c3d71b67 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:32.209023 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-6d77ad13-dec9-49aa-a37a-ee80c3d71b67 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.30 "GET /v2.0/networks?id=3a2e5ab1-9bd9-4597-be91-953ea2afbf4b HTTP/1.1" status: 200  len: 813 time: 0.3128362
Jun 01 10:09:32.218139 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-942bafa1-7b72-4b49-98fa-2647be0aae37 req-9065d1d9-ac4d-4f25-b4af-97b953162810 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:32.219721 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-942bafa1-7b72-4b49-98fa-2647be0aae37 req-9065d1d9-ac4d-4f25-b4af-97b953162810 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.2471693
Jun 01 10:09:32.230269 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Request body: {'port': {'device_id': 'e427e18a-aa21-4460-8e51-4caa872bb8ee', 'network_id': '3a2e5ab1-9bd9-4597-be91-953ea2afbf4b', 'admin_state_up': True, 'tenant_id': '80c0fea786fd4fb9afd054ddb2559c2a'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:09:32.374877 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-942bafa1-7b72-4b49-98fa-2647be0aae37 req-3c32f310-748b-477d-a950-268b0e2bd8ec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1206710
Jun 01 10:09:32.437057 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:09:32.441176 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Usage tracker for resource:port and tenant:80c0fea786fd4fb9afd054ddb2559c2a is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:09:32.443989 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34124) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:32.445037 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:09:32.451183 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:09:32.811895 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Made reservation on behalf of 80c0fea786fd4fb9afd054ddb2559c2a for: {'port': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:09:32.816071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:33.014116 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a449e129-1e4c-4115-ab05-ecb15ef941e8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-401846'] for router_interface, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:33.028966 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3baf8001-4e75-4abb-8482-85e035a01c5a req-852d1793-b26f-4205-8eee-d2a04e3e73c9 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 210 time: 0.0552921
Jun 01 10:09:33.038986 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Allocated IP 172.20.0.7 (3a2e5ab1-9bd9-4597-be91-953ea2afbf4b/f256fe0c-ca2a-4bcd-87a4-40fba935858b/28a39b92-2011-41b3-9cde-cee66d2ea507) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:09:33.264348 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:33.389036 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:33.395573 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:33.469979 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Pushing event updated for resources: {'Port': ['ID=28a39b92-2011-41b3-9cde-cee66d2ea507,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:33.476823 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:33.495790 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Network 3a2e5ab1-9bd9-4597-be91-953ea2afbf4b is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:09:33.502339 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:09:33.505460 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:09:33.516445 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:33.517033 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:33.590984 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-a449e129-1e4c-4115-ab05-ecb15ef941e8 admin admin] Deleting port 2313fd35-8139-4639-b9e5-bd9fc71943ca {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:09:33.591563 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a449e129-1e4c-4115-ab05-ecb15ef941e8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:33.641353 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6644eb66-1b8f-48fb-9cc4-5218dec1f853 req-4ffeb82c-4a0b-4359-97ae-05c8f819378e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:33.643154 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6644eb66-1b8f-48fb-9cc4-5218dec1f853 req-4ffeb82c-4a0b-4359-97ae-05c8f819378e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.0913086
Jun 01 10:09:33.687656 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.4668152
Jun 01 10:09:33.692390 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6644eb66-1b8f-48fb-9cc4-5218dec1f853 req-b7a707da-a2b0-4485-a6aa-a8933a333fb3 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430522
Jun 01 10:09:33.700770 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Request body: {'port': {'device_id': 'e427e18a-aa21-4460-8e51-4caa872bb8ee', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:09:33.727284 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-a449e129-1e4c-4115-ab05-ecb15ef941e8 admin admin] For port 2313fd35-8139-4639-b9e5-bd9fc71943ca, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=2313fd35-8139-4639-b9e5-bd9fc71943ca,segment=NetworkSegment(3982460c-82d6-48e1-a5bd-5d7cbbe910af),segment_id=3982460c-82d6-48e1-a5bd-5d7cbbe910af)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:09:33.727662 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a449e129-1e4c-4115-ab05-ecb15ef941e8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:33.819055 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:33.861040 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-a449e129-1e4c-4115-ab05-ecb15ef941e8 admin admin] Calling delete_port for 2313fd35-8139-4639-b9e5-bd9fc71943ca owned by network:router_interface {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:09:34.243797 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 28a39b92-2011-41b3-9cde-cee66d2ea507 {{(pid=92566) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:09:34.253303 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:34.292230 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cc386d5-d9a8-4a59-b63a-1bdd22822490 req-86c6034b-8093-4b56-912d-c33392ec9c63 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:34.292926 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-7cc386d5-d9a8-4a59-b63a-1bdd22822490 req-86c6034b-8093-4b56-912d-c33392ec9c63 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Synchronizing usage tracker for tenant:80c0fea786fd4fb9afd054ddb2559c2a on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:09:34.308751 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Transition to ACTIVE for port object 28a39b92-2011-41b3-9cde-cee66d2ea507 will not be triggered until provisioned by entity L2. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:09:34.314829 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a449e129-1e4c-4115-ab05-ecb15ef941e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:34.314829 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:34.362169 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a449e129-1e4c-4115-ab05-ecb15ef941e8 admin admin] Pushing event deleted for resources: {'Port': ['ID=2313fd35-8139-4639-b9e5-bd9fc71943ca,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:34.392905 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a449e129-1e4c-4115-ab05-ecb15ef941e8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:34.411751 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-7cc386d5-d9a8-4a59-b63a-1bdd22822490 req-86c6034b-8093-4b56-912d-c33392ec9c63 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Unset dirty status for tenant:80c0fea786fd4fb9afd054ddb2559c2a on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:09:34.417698 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7cc386d5-d9a8-4a59-b63a-1bdd22822490 req-86c6034b-8093-4b56-912d-c33392ec9c63 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 931 time: 0.2444265
Jun 01 10:09:34.458038 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:34.464614 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-d34ab0be-bf6a-445d-8fa7-21d8f105fd49 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:34.497776 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7cc386d5-d9a8-4a59-b63a-1bdd22822490 req-8a859780-6c88-490c-a0aa-f686ad33768e tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0776641
Jun 01 10:09:34.619596 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Pushing event updated for resources: {'Port': ['ID=28a39b92-2011-41b3-9cde-cee66d2ea507,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:34.628168 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:34.657547 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a449e129-1e4c-4115-ab05-ecb15ef941e8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7875317', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-405030'] for router_interface, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:34.659441 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Attempting to bind port 28a39b92-2011-41b3-9cde-cee66d2ea507 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:09:34.659951 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Attempting to bind port 28a39b92-2011-41b3-9cde-cee66d2ea507 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': 'f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '3a2e5ab1-9bd9-4597-be91-953ea2afbf4b'}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:09:34.660575 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Attempting to bind port 28a39b92-2011-41b3-9cde-cee66d2ea507 on network 3a2e5ab1-9bd9-4597-be91-953ea2afbf4b {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:09:34.668917 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Port 28a39b92-2011-41b3-9cde-cee66d2ea507 on network 3a2e5ab1-9bd9-4597-be91-953ea2afbf4b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:09:34.670167 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Attempting to bind port 28a39b92-2011-41b3-9cde-cee66d2ea507 on network 3a2e5ab1-9bd9-4597-be91-953ea2afbf4b {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:09:34.675305 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 9, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:09:34.675786 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Checking segment: {'id': 'f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '3a2e5ab1-9bd9-4597-be91-953ea2afbf4b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:09:34.676180 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Bound using segment: {'id': 'f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '3a2e5ab1-9bd9-4597-be91-953ea2afbf4b'} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:09:34.676609 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Bound port: 28a39b92-2011-41b3-9cde-cee66d2ea507, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '3a2e5ab1-9bd9-4597-be91-953ea2afbf4b'}}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:09:34.676953 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:34.924052 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] For port 28a39b92-2011-41b3-9cde-cee66d2ea507, host hv-cinder-78726, cleared binding levels {{(pid=92566) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:09:34.928706 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] For port 28a39b92-2011-41b3-9cde-cee66d2ea507, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=28a39b92-2011-41b3-9cde-cee66d2ea507,segment=NetworkSegment(f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793),segment_id=f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793)] {{(pid=92566) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:09:34.954307 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac51c0ec-4b74-4112-bfdd-9cfffdacda95 req-fbd52047-9a29-4b6d-875f-2454fcad310c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:34.955999 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac51c0ec-4b74-4112-bfdd-9cfffdacda95 req-fbd52047-9a29-4b6d-875f-2454fcad310c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.1309474
Jun 01 10:09:35.003706 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:35.010713 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:35.057948 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac51c0ec-4b74-4112-bfdd-9cfffdacda95 req-e8f156c6-6714-4be9-b136-3f4d84121bd0 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0929635
Jun 01 10:09:35.076532 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:35.083726 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:35.083726 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] 10.222.0.30 "PUT /v2.0/ports/28a39b92-2011-41b3-9cde-cee66d2ea507 HTTP/1.1" status: 200  len: 1093 time: 1.3832419
Jun 01 10:09:35.083726 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e427e18a-aa21-4460-8e51-4caa872bb8ee', 'tag': '28a39b92-2011-41b3-9cde-cee66d2ea507'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:09:35.083726 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-70a7b210-ac28-470f-9674-227a3077b648" -d '{"events": [{"name": "network-changed", "server_uuid": "e427e18a-aa21-4460-8e51-4caa872bb8ee", "tag": "28a39b92-2011-41b3-9cde-cee66d2ea507"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:09:35.104545 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Pushing event updated for resources: {'Port': ['ID=28a39b92-2011-41b3-9cde-cee66d2ea507,revision_number=3']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:35.108027 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:35.138928 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:09:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-47a2fc3b-c402-4383-8ba0-356b1f73ec8e x-openstack-request-id: req-47a2fc3b-c402-4383-8ba0-356b1f73ec8e {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:09:35.139276 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e427e18a-aa21-4460-8e51-4caa872bb8ee", "tag": "28a39b92-2011-41b3-9cde-cee66d2ea507", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:09:35.139536 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-47a2fc3b-c402-4383-8ba0-356b1f73ec8e {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:09:35.139960 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e427e18a-aa21-4460-8e51-4caa872bb8ee', 'tag': '28a39b92-2011-41b3-9cde-cee66d2ea507', 'status': 'completed', 'code': 200}
Jun 01 10:09:35.172113 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a449e129-1e4c-4115-ab05-ecb15ef941e8 admin admin] Router 369d44f0-4eb2-4ec0-94e5-1562c07efd26 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:09:35.239522 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70a7b210-ac28-470f-9674-227a3077b648 req-077ea833-2634-4115-a782-4c0c797899eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:35.241588 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-70a7b210-ac28-470f-9674-227a3077b648 req-077ea833-2634-4115-a782-4c0c797899eb service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=80c0fea786fd4fb9afd054ddb2559c2a&device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 1096 time: 0.0746727
Jun 01 10:09:35.352786 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a449e129-1e4c-4115-ab05-ecb15ef941e8 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:09:35.363939 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-066c5eb0-e0c7-47a4-816d-5bda24c66fde None None] Sync routers for ids ['369d44f0-4eb2-4ec0-94e5-1562c07efd26'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:09:35.374273 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-066c5eb0-e0c7-47a4-816d-5bda24c66fde None None] Routers {'369d44f0-4eb2-4ec0-94e5-1562c07efd26'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:09:35.374998 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-066c5eb0-e0c7-47a4-816d-5bda24c66fde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe726948e0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:09:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['369d44f0-4eb2-4ec0-94e5-1562c07efd26'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:09:35.390079 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70a7b210-ac28-470f-9674-227a3077b648 req-c6c47145-8634-4368-bc15-a19a249d0e24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:35.395397 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-70a7b210-ac28-470f-9674-227a3077b648 req-c6c47145-8634-4368-bc15-a19a249d0e24 service neutron] 10.222.0.30 "GET /v2.0/networks?tenant_id=80c0fea786fd4fb9afd054ddb2559c2a&shared=False HTTP/1.1" status: 200  len: 914 time: 0.1417668
Jun 01 10:09:35.479330 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-a449e129-1e4c-4115-ab05-ecb15ef941e8 admin admin] 10.222.0.68 "PUT /v2.0/routers/369d44f0-4eb2-4ec0-94e5-1562c07efd26/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.0345838
Jun 01 10:09:35.481458 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34156) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:35.547975 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70a7b210-ac28-470f-9674-227a3077b648 req-f8202dbc-bba0-4b03-abe9-0effaf595165 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:35.549451 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-70a7b210-ac28-470f-9674-227a3077b648 req-f8202dbc-bba0-4b03-abe9-0effaf595165 service neutron] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1511185
Jun 01 10:09:35.594983 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-066c5eb0-e0c7-47a4-816d-5bda24c66fde None None] Set router 369d44f0-4eb2-4ec0-94e5-1562c07efd26 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:09:35.696486 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] Notify callbacks [] for router, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:35.740369 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-ebb6546d-ec3f-4191-9c4b-07422c3d1197 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:35.742577 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-ebb6546d-ec3f-4191-9c4b-07422c3d1197 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=80c0fea786fd4fb9afd054ddb2559c2a&device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 1096 time: 0.1475403
Jun 01 10:09:35.753870 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0671a632-76da-4564-ae11-b0ef271cb738 req-dabdc420-c53a-4da9-bd34-895a297d4ec3 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:35.761042 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0671a632-76da-4564-ae11-b0ef271cb738 req-dabdc420-c53a-4da9-bd34-895a297d4ec3 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 943 time: 0.1286094
Jun 01 10:09:35.852516 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-9316c76a-ecfb-4e5b-9ee0-97f61f88c656 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=28a39b92-2011-41b3-9cde-cee66d2ea507 HTTP/1.1" status: 200  len: 217 time: 0.0742164
Jun 01 10:09:35.894722 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:35.919927 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0671a632-76da-4564-ae11-b0ef271cb738 req-97f00e19-6d33-4201-a587-e471ac69a7b0 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1574123
Jun 01 10:09:35.938067 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-066c5eb0-e0c7-47a4-816d-5bda24c66fde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe726948e0>, [{'id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'name': 'tempest-ServerRescueNegativeTestJSON-1852296292-router', 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.219'}], 'enable_snat': True}, 'gw_port_id': 'd943f1f4-e253-47b0-93f0-2e7e1f117536', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:09:34Z', 'revision_number': 5, 'project_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'gw_port': {'id': 'd943f1f4-e253-47b0-93f0-2e7e1f117536', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:8b:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:09:35.942620 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-03e80498-a603-47b2-a420-fd7c4c6ae4cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:35.942620 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-03e80498-a603-47b2-a420-fd7c4c6ae4cd service neutron] 10.222.0.30 "GET /v2.0/subnets?id=f256fe0c-ca2a-4bcd-87a4-40fba935858b HTTP/1.1" status: 200  len: 853 time: 0.0800283
Jun 01 10:09:35.942820 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-066c5eb0-e0c7-47a4-816d-5bda24c66fde None None] Checking router: 369d44f0-4eb2-4ec0-94e5-1562c07efd26 for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:09:35.950765 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-066c5eb0-e0c7-47a4-816d-5bda24c66fde None None] Routers {'369d44f0-4eb2-4ec0-94e5-1562c07efd26'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:09:35.951341 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-066c5eb0-e0c7-47a4-816d-5bda24c66fde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe726948e0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:09:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['369d44f0-4eb2-4ec0-94e5-1562c07efd26'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:09:35.995491 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-09726ee9-94ea-4bf1-91bc-224e699c57cd service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=3a2e5ab1-9bd9-4597-be91-953ea2afbf4b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0458634
Jun 01 10:09:36.070022 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] Deleting port d943f1f4-e253-47b0-93f0-2e7e1f117536 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:09:36.070022 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:36.123654 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-066c5eb0-e0c7-47a4-816d-5bda24c66fde None None] Set router 369d44f0-4eb2-4ec0-94e5-1562c07efd26 gateway port host: None {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:09:36.232677 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-6117370d-c6cc-45fb-832b-5849948f66d7 service neutron] 10.222.0.30 "GET /v2.0/networks/3a2e5ab1-9bd9-4597-be91-953ea2afbf4b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2273178
Jun 01 10:09:36.261037 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] For port d943f1f4-e253-47b0-93f0-2e7e1f117536, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=d943f1f4-e253-47b0-93f0-2e7e1f117536,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:09:36.261609 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:36.322151 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-066c5eb0-e0c7-47a4-816d-5bda24c66fde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe726948e0>, [{'id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'name': 'tempest-ServerRescueNegativeTestJSON-1852296292-router', 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:09:35Z', 'revision_number': 6, 'project_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'gw_port_host': None}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:09:36.327635 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-066c5eb0-e0c7-47a4-816d-5bda24c66fde None None] The sync data for ids ['369d44f0-4eb2-4ec0-94e5-1562c07efd26'] in dv-cinder-787262-4-iscsi is: [{'id': '369d44f0-4eb2-4ec0-94e5-1562c07efd26', 'name': 'tempest-ServerRescueNegativeTestJSON-1852296292-router', 'tenant_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:09:35Z', 'revision_number': 6, 'project_id': 'ef4bc75ba53a44cca2e4b7c2b8aeb818', 'gw_port_host': None}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:09:36.416664 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] Calling delete_port for d943f1f4-e253-47b0-93f0-2e7e1f117536 owned by network:router_gateway {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:09:36.453534 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12b12e11-d077-4676-972d-e1e03fc11a88 req-180cab23-a7e1-4258-8213-d7cb2522eefe service neutron] 10.222.0.30 "GET /v2.0/networks/3a2e5ab1-9bd9-4597-be91-953ea2afbf4b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2109950
Jun 01 10:09:36.474032 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d39aecb-d41d-4738-a7cb-478017426fc7 req-cf1331be-99ca-4a57-a762-786da66e9322 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:36.475747 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6d39aecb-d41d-4738-a7cb-478017426fc7 req-cf1331be-99ca-4a57-a762-786da66e9322 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.1491089
Jun 01 10:09:36.525314 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6d39aecb-d41d-4738-a7cb-478017426fc7 req-12be7813-c75c-4e6f-808d-f2c6b0fed149 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0435483
Jun 01 10:09:36.714016 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34172) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:36.772324 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:36.777681 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:36.825036 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] Pushing event deleted for resources: {'Port': ['ID=d943f1f4-e253-47b0-93f0-2e7e1f117536,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:36.855328 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:36.912328 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f8bfc0e4-25d2-4b1e-b577-5fe3a2155523 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:36.941137 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-f8bfc0e4-25d2-4b1e-b577-5fe3a2155523 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:09:36.949081 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f8bfc0e4-25d2-4b1e-b577-5fe3a2155523 admin admin] Usage tracker for resource:security_group_rule and tenant:d3baf9fee37048ae98644c20ab290894 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:09:36.953608 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f8bfc0e4-25d2-4b1e-b577-5fe3a2155523 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:09:36.962518 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-f8bfc0e4-25d2-4b1e-b577-5fe3a2155523 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:09:36.967366 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-403627'] for router_gateway, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:37.111285 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de262793-fa43-497c-aaa6-f994c709e708 req-05b636b4-5998-4c43-b069-ffd8f191bbc7 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:37.112762 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-de262793-fa43-497c-aaa6-f994c709e708 req-05b636b4-5998-4c43-b069-ffd8f191bbc7 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 943 time: 0.0854518
Jun 01 10:09:37.160653 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-de262793-fa43-497c-aaa6-f994c709e708 req-95514902-7f70-4c18-8398-3140d519590c tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415268
Jun 01 10:09:37.161572 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-405542', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-15816'] for router, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:37.165198 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:37.305784 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f8bfc0e4-25d2-4b1e-b577-5fe3a2155523 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:37.388989 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-406042'] for router, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:37.389499 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] Fanout notify agent at l3_agent the message router_deleted on router 369d44f0-4eb2-4ec0-94e5-1562c07efd26 {{(pid=92565) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 10:09:37.412032 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] Notify callbacks [] for router, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:37.413168 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] 10.222.0.68 "DELETE /v2.0/routers/369d44f0-4eb2-4ec0-94e5-1562c07efd26 HTTP/1.1" status: 204  len: 168 time: 1.9303093
Jun 01 10:09:37.415634 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34184) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:37.453865 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f8bfc0e4-25d2-4b1e-b577-5fe3a2155523 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:37.467483 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:37.509364 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device d943f1f4-e253-47b0-93f0-2e7e1f117536 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:09:37.522647 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-f8bfc0e4-25d2-4b1e-b577-5fe3a2155523 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=d3baf9fee37048ae98644c20ab290894&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8073902
Jun 01 10:09:37.526314 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 34188) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:37.529188 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_v2 [None req-ad93adc3-23b5-4e5a-88ad-d4a435020eca admin admin] Deleting subnet 2ee54c26-f286-4f9a-b791-24aa84feb26a {{(pid=92565) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 10:09:37.533347 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8bfc0e4-25d2-4b1e-b577-5fe3a2155523 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9933f4ea-c635-470f-866d-3cb1fa2c13b0,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:37.535048 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f8bfc0e4-25d2-4b1e-b577-5fe3a2155523 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:37.535732 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ad93adc3-23b5-4e5a-88ad-d4a435020eca admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:37.549232 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: d943f1f4-e253-47b0-93f0-2e7e1f117536 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:09:37.549552 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device d943f1f4-e253-47b0-93f0-2e7e1f117536 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:09:37.550026 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 2313fd35-8139-4639-b9e5-bd9fc71943ca no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:09:37.590678 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: 2313fd35-8139-4639-b9e5-bd9fc71943ca {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:09:37.594753 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 2313fd35-8139-4639-b9e5-bd9fc71943ca not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:09:37.604615 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ad93adc3-23b5-4e5a-88ad-d4a435020eca admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2998467'] for subnet, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:37.629333 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-db176fce-6fbf-4055-bb62-e1f8e51386c5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:37.668336 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ad93adc3-23b5-4e5a-88ad-d4a435020eca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7791835'] for subnet, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:37.690259 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-db176fce-6fbf-4055-bb62-e1f8e51386c5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:37.772964 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45c6f085-5b3a-42d7-b71e-4a6cc3af3199 req-0529b9e1-40a2-401a-9299-4a2e495e6d0e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:37.774417 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-45c6f085-5b3a-42d7-b71e-4a6cc3af3199 req-0529b9e1-40a2-401a-9299-4a2e495e6d0e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 944 time: 0.1248543
Jun 01 10:09:37.832281 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-45c6f085-5b3a-42d7-b71e-4a6cc3af3199 req-cecd5f64-11cc-48ae-9f81-afabf75b62c9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0468256
Jun 01 10:09:37.926081 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-db176fce-6fbf-4055-bb62-e1f8e51386c5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:37.932882 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-5dafba26-ff92-44b5-b965-d59a186334ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:37.946828 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db176fce-6fbf-4055-bb62-e1f8e51386c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9933f4ea-c635-470f-866d-3cb1fa2c13b0,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:37.952279 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-db176fce-6fbf-4055-bb62-e1f8e51386c5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:37.954130 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-db176fce-6fbf-4055-bb62-e1f8e51386c5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:37.963282 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-db176fce-6fbf-4055-bb62-e1f8e51386c5 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/9933f4ea-c635-470f-866d-3cb1fa2c13b0 HTTP/1.1" status: 204  len: 168 time: 0.4305723
Jun 01 10:09:38.018035 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ad93adc3-23b5-4e5a-88ad-d4a435020eca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7793006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2233195', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3139387'] for subnet, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:38.023936 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-1bc48c4e-56d2-4c3a-bc70-eecb5b338383 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:38.043219 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device ba4fa832-87bd-477b-bad8-2837ab09304a details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:09:38.063816 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ad93adc3-23b5-4e5a-88ad-d4a435020eca admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:38.066436 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad93adc3-23b5-4e5a-88ad-d4a435020eca admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2ee54c26-f286-4f9a-b791-24aa84feb26a,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:38.068546 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-ad93adc3-23b5-4e5a-88ad-d4a435020eca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:38.073493 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-ad93adc3-23b5-4e5a-88ad-d4a435020eca admin admin] 10.222.0.68 "DELETE /v2.0/subnets/2ee54c26-f286-4f9a-b791-24aa84feb26a HTTP/1.1" status: 204  len: 168 time: 0.6568546
Jun 01 10:09:38.076120 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 34198) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:38.186851 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port ba4fa832-87bd-477b-bad8-2837ab09304a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ba4fa832-87bd-477b-bad8-2837ab09304a,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:09:38.201748 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': 'ba4fa832-87bd-477b-bad8-2837ab09304a', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'port_id': 'ba4fa832-87bd-477b-bad8-2837ab09304a', 'mac_address': 'fa:16:3e:54:58:da', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 861, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:09:38.269862 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7813807'] for network, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:38.272669 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:38.298702 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ba4fa832-87bd-477b-bad8-2837ab09304a {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:09:38.315898 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port ba4fa832-87bd-477b-bad8-2837ab09304a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ba4fa832-87bd-477b-bad8-2837ab09304a,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:09:38.435182 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:38.444728 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:38.453294 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7795028', 'neutron.services.segments.db._delete_segments_for_network-8726958294492'] for network, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:38.473117 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7efe7246bf40>> segment before_delete 55550000 {{(pid=92566) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:09:38.473117 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7efe7246bf40>> subnet precommit_delete_associations 55550000 {{(pid=92566) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:09:38.473117 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7efe714129a0>> segment_host_mapping after_create 55550000 {{(pid=92566) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:09:38.473117 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7efe714129a0>> port after_create 55550000 {{(pid=92566) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:09:38.473117 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7efe714129a0>> port after_delete 55550000 {{(pid=92566) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:09:38.473117 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7efe714129a0>> port after_update 55550000 {{(pid=92566) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:09:38.473117 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7efe714129a0>> segment after_delete 55550000 {{(pid=92566) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:09:38.473775 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7efe714129a0>> subnet after_create 55550000 {{(pid=92566) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:09:38.473775 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7efe714129a0>> subnet after_delete 55550000 {{(pid=92566) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:09:38.473994 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7efe714129a0>> subnet after_update 55550000 {{(pid=92566) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:09:38.509978 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=ba4fa832-87bd-477b-bad8-2837ab09304a,revision_number=9']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:38.513012 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:38.564550 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7efe7154b1c0>> subnet after_create 55550000 {{(pid=92566) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:09:38.565218 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7efe7154b1c0>> subnet after_delete 55550000 {{(pid=92566) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:09:38.565218 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7efe7154b1c0>> subnet before_create 55550000 {{(pid=92566) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:09:38.565519 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7efe7154b1c0>> subnet before_update 55550000 {{(pid=92566) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 10:09:38.565881 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.services.segments.db [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7efe7246b160>,) {'filters': {'network_id': ['34268ce8-8baf-41d5-acbc-1b6c167dd481']}} {{(pid=92566) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:09:38.583600 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.services.segments.db [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7efe7246b160>, '3982460c-82d6-48e1-a5bd-5d7cbbe910af') {'for_net_delete': True} {{(pid=92566) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:09:38.583600 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.services.segments.db [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7efe7246b160>, '3982460c-82d6-48e1-a5bd-5d7cbbe910af') {} {{(pid=92566) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:09:38.602679 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726958303133', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1800609'] for segment, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:38.631337 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac965e52-a830-4309-8a17-4765817c7d44 req-8f69501c-4a25-4013-a161-58372c2287ae tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:38.633076 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac965e52-a830-4309-8a17-4765817c7d44 req-8f69501c-4a25-4013-a161-58372c2287ae tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 943 time: 0.3189001
Jun 01 10:09:38.634137 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:38.657178 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Releasing vlan 859 on physical network physnet1 to pool {{(pid=92566) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 10:09:38.657576 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2757849'] for segment, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:   from cryptography.utils import int_from_bytes
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:   from cryptography.utils import int_from_bytes
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]: Traceback (most recent call last):
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:     timer()
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:     cb(*args, **kw)
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:     return func(*args, **kwargs)
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:     self._notify()
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:     self.callback(batched_events)
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:     event.method(event)
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:     return f(self, *a, **k)
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:     return self._get(url).json()
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:     return self.request(url, 'GET', **kwargs)
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 10:09:38.673932 dv-cinder-787262-4-iscsi neutron-server[92566]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 10:09:38.681888 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['ba4fa832-87bd-477b-bad8-2837ab09304a'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:09:38.773753 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac965e52-a830-4309-8a17-4765817c7d44 req-a4a82562-33d7-4e1c-bbc7-733a8f7f6e45 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1310117
Jun 01 10:09:38.852242 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7795037', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-403638'] for network, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:38.860716 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:38.865459 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-ba20ba92-f3a5-4ac8-a238-9d6bf452d471 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:38.888942 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Pushing event deleted for resources: {'Network': ['ID=34268ce8-8baf-41d5-acbc-1b6c167dd481,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:38.891619 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:38.992741 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-a46cf5b8-ad3c-4880-9b57-72716fc13429 admin admin] 10.222.0.68 "DELETE /v2.0/networks/34268ce8-8baf-41d5-acbc-1b6c167dd481 HTTP/1.1" status: 204  len: 168 time: 0.9155357
Jun 01 10:09:39.045063 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c4942c-6954-49fa-b0d1-30ccb3ce7fc0 req-de8512a9-d958-4de3-bdb2-d319f0660aa9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:39.046751 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-56c4942c-6954-49fa-b0d1-30ccb3ce7fc0 req-de8512a9-d958-4de3-bdb2-d319f0660aa9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 945 time: 0.0954187
Jun 01 10:09:39.100315 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-56c4942c-6954-49fa-b0d1-30ccb3ce7fc0 req-a01ba2b1-4f70-4da7-b982-55dfdaa0583e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0461156
Jun 01 10:09:39.454783 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 34238) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:39.510984 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-ff3bc3a3-6c56-46cd-90ab-4798387c281a admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=ef4bc75ba53a44cca2e4b7c2b8aeb818&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0545049
Jun 01 10:09:39.513418 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 34246) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:39.582619 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-73fea1ce-23c5-4970-b38a-26e466afcc83 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:39.613758 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-73fea1ce-23c5-4970-b38a-26e466afcc83 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:39.766351 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-73fea1ce-23c5-4970-b38a-26e466afcc83 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:39.771328 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-ea7d5152-c3a0-41fb-ac45-913b80c5b144 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:39.784489 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73fea1ce-23c5-4970-b38a-26e466afcc83 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=08fd5072-fefe-41fa-99a7-81ac5461f2b4,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:39.787040 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-73fea1ce-23c5-4970-b38a-26e466afcc83 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:39.864812 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-73fea1ce-23c5-4970-b38a-26e466afcc83 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:39.865913 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-73fea1ce-23c5-4970-b38a-26e466afcc83 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/08fd5072-fefe-41fa-99a7-81ac5461f2b4 HTTP/1.1" status: 204  len: 168 time: 0.3515682
Jun 01 10:09:39.962205 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c55f0951-c0d0-4817-8444-0843a5d854d6 req-774ead44-3618-4795-996c-1300a5637064 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:39.964282 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c55f0951-c0d0-4817-8444-0843a5d854d6 req-774ead44-3618-4795-996c-1300a5637064 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 943 time: 0.0867338
Jun 01 10:09:40.013560 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c55f0951-c0d0-4817-8444-0843a5d854d6 req-504a1a59-0b9e-43c6-be74-d2140d2b63a1 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433352
Jun 01 10:09:40.061094 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 28a39b92-2011-41b3-9cde-cee66d2ea507 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:09:40.068038 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device ba4fa832-87bd-477b-bad8-2837ab09304a up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:09:40.249124 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port ba4fa832-87bd-477b-bad8-2837ab09304a triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:09:40.249489 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:40.344548 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc37d789-d8b6-4bc6-8807-d6d6f9e6ab31 req-a2444a3e-1b12-4f25-a13f-c42c71047454 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:40.346291 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dc37d789-d8b6-4bc6-8807-d6d6f9e6ab31 req-a2444a3e-1b12-4f25-a13f-c42c71047454 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 945 time: 0.1166511
Jun 01 10:09:40.370164 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 28a39b92-2011-41b3-9cde-cee66d2ea507, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=28a39b92-2011-41b3-9cde-cee66d2ea507,segment=NetworkSegment(f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793),segment_id=f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:09:40.382471 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': '28a39b92-2011-41b3-9cde-cee66d2ea507', 'network_id': '3a2e5ab1-9bd9-4597-be91-953ea2afbf4b', 'port_id': '28a39b92-2011-41b3-9cde-cee66d2ea507', 'mac_address': 'fa:16:3e:06:3a:a8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 898, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f256fe0c-ca2a-4bcd-87a4-40fba935858b', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:09:40.427524 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dc37d789-d8b6-4bc6-8807-d6d6f9e6ab31 req-e3192f2b-20f2-47f5-9acd-3b530b468b23 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0693426
Jun 01 10:09:40.527813 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:40.545044 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:40.570075 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 28a39b92-2011-41b3-9cde-cee66d2ea507 {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:09:40.579210 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '77032f84-7f38-4e7e-b0fd-accc20754797', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ba4fa832-87bd-477b-bad8-2837ab09304a'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:09:40.581457 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-012f4a96-b849-4bde-929a-bc25bdf370a8" -d '{"events": [{"server_uuid": "77032f84-7f38-4e7e-b0fd-accc20754797", "name": "network-vif-plugged", "status": "completed", "tag": "ba4fa832-87bd-477b-bad8-2837ab09304a"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:09:40.590484 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-baea649a-7c97-420e-a76c-08fd98c0c696 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:40.599225 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port ba4fa832-87bd-477b-bad8-2837ab09304a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ba4fa832-87bd-477b-bad8-2837ab09304a,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:09:40.600877 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 28a39b92-2011-41b3-9cde-cee66d2ea507, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=28a39b92-2011-41b3-9cde-cee66d2ea507,segment=NetworkSegment(f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793),segment_id=f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:09:40.631751 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:09:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-757b1793-8578-469a-88d0-5375095617d9 x-openstack-request-id: req-757b1793-8578-469a-88d0-5375095617d9 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:09:40.632053 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "77032f84-7f38-4e7e-b0fd-accc20754797", "name": "network-vif-plugged", "status": "completed", "tag": "ba4fa832-87bd-477b-bad8-2837ab09304a", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:09:40.632317 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-757b1793-8578-469a-88d0-5375095617d9 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:09:40.632768 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '77032f84-7f38-4e7e-b0fd-accc20754797', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ba4fa832-87bd-477b-bad8-2837ab09304a', 'code': 200}
Jun 01 10:09:40.682774 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:40.684628 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:40.713479 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:40.758924 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=28a39b92-2011-41b3-9cde-cee66d2ea507,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:40.762057 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:40.762464 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.042s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:40.827187 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=ba4fa832-87bd-477b-bad8-2837ab09304a,revision_number=10']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:40.830365 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:40.924191 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['28a39b92-2011-41b3-9cde-cee66d2ea507'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:09:41.179355 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34284) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:41.246361 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e42c1474-9248-4acc-95c2-9001bf443cb7 req-ea54afbd-462b-449f-be9a-36cacd704505 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:41.247881 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e42c1474-9248-4acc-95c2-9001bf443cb7 req-ea54afbd-462b-449f-be9a-36cacd704505 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 944 time: 0.0933704
Jun 01 10:09:41.299432 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1696941905-network', 'tenant_id': '4f2a9e1dcd084ba7aeb9c96724aea0fe'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:09:41.303980 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:09:41.307911 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Usage tracker for resource:network and tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:09:41.310793 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:09:41.316609 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:09:41.352681 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e42c1474-9248-4acc-95c2-9001bf443cb7 req-61368bfc-23de-4204-9322-09cc69a55829 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0989242
Jun 01 10:09:41.378423 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b993a585-e8f7-4f66-af25-d2131931f027 req-dbe0a1a9-fd48-4cd4-a374-8ca81028094c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:41.379910 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b993a585-e8f7-4f66-af25-d2131931f027 req-dbe0a1a9-fd48-4cd4-a374-8ca81028094c service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 1100 time: 0.1103706
Jun 01 10:09:41.412372 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Made reservation on behalf of 4f2a9e1dcd084ba7aeb9c96724aea0fe for: {'network': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:09:41.414828 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:41.422219 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b993a585-e8f7-4f66-af25-d2131931f027 req-6a5ef980-1a5d-4922-be63-0775183b82b4 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0349469
Jun 01 10:09:41.428161 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:41.441301 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:09:41.445129 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Usage tracker for resource:security_group_rule and tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:09:41.448623 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:09:41.454218 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:09:41.543475 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:41.627721 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:41.631129 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-551d3aab-7734-488f-8ecd-4662293c23be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:41.631570 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db2c2bf0-9db3-4b6e-9303-cc0a6ca903c4 req-ed9d96a0-44e4-4b09-a0e8-f6d956b8f1fe tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:41.633071 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-db2c2bf0-9db3-4b6e-9303-cc0a6ca903c4 req-ed9d96a0-44e4-4b09-a0e8-f6d956b8f1fe tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 947 time: 0.0892496
Jun 01 10:09:41.665057 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 897}  {{(pid=92565) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:09:41.670749 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bfdc1692-8d5a-493a-a2d7-b6e2daa11404,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:41.683127 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:41.687591 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:41.688115 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.segments_db [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Added segment f512f187-5724-4ff7-afd5-c422b0bd8ba7 of type vlan for network 95462097-1cc6-4207-9add-1b65afcf40ca
Jun 01 10:09:41.691301 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-db2c2bf0-9db3-4b6e-9303-cc0a6ca903c4 req-ef0c4ff4-d601-47bd-b68f-3bc2e9331b66 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0513527
Jun 01 10:09:41.715201 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:41.821636 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:41.823619 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:41.824203 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:41.828021 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-5aedd9dd-f0b6-4560-9de1-41e0d3c52f05 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:41.929297 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Pushing event updated for resources: {'Network': ['ID=95462097-1cc6-4207-9add-1b65afcf40ca,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:41.932058 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:41.938801 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network 95462097-1cc6-4207-9add-1b65afcf40ca details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:09:41.984392 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 0.8037281
Jun 01 10:09:41.987091 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34298) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:41.993206 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] Request body: {'subnet': {'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1696941905-subnet', 'tenant_id': '4f2a9e1dcd084ba7aeb9c96724aea0fe', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:09:41.998174 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:09:42.002339 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] Usage tracker for resource:subnet and tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:09:42.005343 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:09:42.013122 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:09:42.072280 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 28a39b92-2011-41b3-9cde-cee66d2ea507 up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:09:42.080229 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] Made reservation on behalf of 4f2a9e1dcd084ba7aeb9c96724aea0fe for: {'subnet': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:09:42.082816 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3139364'] for subnet, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:42.272648 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port 28a39b92-2011-41b3-9cde-cee66d2ea507 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:09:42.278158 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port 28a39b92-2011-41b3-9cde-cee66d2ea507 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:09:42.278714 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:42.407365 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:42.451870 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 28a39b92-2011-41b3-9cde-cee66d2ea507, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=28a39b92-2011-41b3-9cde-cee66d2ea507,segment=NetworkSegment(f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793),segment_id=f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:09:42.549128 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:42.551080 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:42.612641 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-801969e0-94ed-463b-80e3-1dded7fa106c req-33150af3-7e64-4e4f-b115-ac35f17da4e3 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:42.615691 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-801969e0-94ed-463b-80e3-1dded7fa106c req-33150af3-7e64-4e4f-b115-ac35f17da4e3 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 944 time: 0.1078181
Jun 01 10:09:42.637030 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e427e18a-aa21-4460-8e51-4caa872bb8ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '28a39b92-2011-41b3-9cde-cee66d2ea507'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:09:42.639601 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8a4739be-9f58-4432-b313-a214b1c6f5ad" -d '{"events": [{"server_uuid": "e427e18a-aa21-4460-8e51-4caa872bb8ee", "name": "network-vif-plugged", "status": "completed", "tag": "28a39b92-2011-41b3-9cde-cee66d2ea507"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:09:42.645091 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=28a39b92-2011-41b3-9cde-cee66d2ea507,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:42.651036 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:42.691287 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-801969e0-94ed-463b-80e3-1dded7fa106c req-ec59d472-054b-4f8a-aeb7-0649e85c656a tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0690622
Jun 01 10:09:42.693146 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:09:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3dfb7c81-a0bc-4b58-8e87-eb8cb45972b6 x-openstack-request-id: req-3dfb7c81-a0bc-4b58-8e87-eb8cb45972b6 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:09:42.693447 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e427e18a-aa21-4460-8e51-4caa872bb8ee", "name": "network-vif-plugged", "status": "completed", "tag": "28a39b92-2011-41b3-9cde-cee66d2ea507", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:09:42.693710 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-3dfb7c81-a0bc-4b58-8e87-eb8cb45972b6 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:09:42.694109 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e427e18a-aa21-4460-8e51-4caa872bb8ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '28a39b92-2011-41b3-9cde-cee66d2ea507', 'code': 200}
Jun 01 10:09:42.761306 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2233128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3139378'] for subnet, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:42.766469 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:42.841986 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] Pushing event updated for resources: {'Subnet': ['ID=abf69321-90c0-4336-ac76-6ef3766e6a67,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:42.848615 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:42.853406 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] Checking segment: {'id': 'f512f187-5724-4ff7-afd5-c422b0bd8ba7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92565) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:09:42.854407 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] Network hostable DHCP agents. Network: 95462097-1cc6-4207-9add-1b65afcf40ca, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92565) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:09:42.886713 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae7e06c0-c9a3-483b-b38c-114166c96b08 req-7b67da4c-2d00-4779-9ff5-6ad40ffadcfc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:42.888180 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ae7e06c0-c9a3-483b-b38c-114166c96b08 req-7b67da4c-2d00-4779-9ff5-6ad40ffadcfc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 947 time: 0.0837636
Jun 01 10:09:42.933295 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ae7e06c0-c9a3-483b-b38c-114166c96b08 req-be71b93f-94c8-4329-a65d-5add42cb8dea tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0392182
Jun 01 10:09:42.983109 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] Network 95462097-1cc6-4207-9add-1b65afcf40ca is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92565) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:09:43.040172 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-0ab55894-35ae-4ccb-9966-40ab518af15c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:43.108861 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, 95462097-1cc6-4207-9add-1b65afcf40ca) {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:09:43.117539 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e43fe0e7-3738-459e-8eb3-c4e2fa4af275 None None] Network 95462097-1cc6-4207-9add-1b65afcf40ca requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:09:43.117944 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:43.118631 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:43.218360 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 852 time: 1.2300591
Jun 01 10:09:43.282683 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:43.325537 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b83bcd0-9d6b-47e1-8a1c-fd79f3b41a81 None None] Network 95462097-1cc6-4207-9add-1b65afcf40ca requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:09:44.013663 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-d5928daa-f6e5-437a-a02c-d648be7e8207 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:44.015121 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-d5928daa-f6e5-437a-a02c-d648be7e8207 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/networks?id=95462097-1cc6-4207-9add-1b65afcf40ca HTTP/1.1" status: 200  len: 815 time: 0.2859979
Jun 01 10:09:44.017351 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:44.037890 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea485051-41db-4cfe-ba01-e33a6b7d10f7 req-e4c62416-59b0-4c62-8111-894a8d259f1e tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:44.039481 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ea485051-41db-4cfe-ba01-e33a6b7d10f7 req-e4c62416-59b0-4c62-8111-894a8d259f1e tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 945 time: 0.2311473
Jun 01 10:09:44.042125 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-ee537051-6d41-48c3-a548-9e26abc64d00 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/quotas/4f2a9e1dcd084ba7aeb9c96724aea0fe HTTP/1.1" status: 200  len: 375 time: 0.0214417
Jun 01 10:09:44.112361 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-dd04986a-2290-4c42-856e-a9b109e7543b tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=4f2a9e1dcd084ba7aeb9c96724aea0fe&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0536537
Jun 01 10:09:44.143384 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ea485051-41db-4cfe-ba01-e33a6b7d10f7 req-7c470318-dc86-4cad-a277-b27db943e183 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0974121
Jun 01 10:09:44.300703 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-4880a01f-b060-42b7-967c-32a3202c44d1 service neutron] 10.222.0.68 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1804278
Jun 01 10:09:44.436996 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c87feb76-16f3-4a73-93ff-f222440345f8 req-f10a3f7d-8bb8-4cbe-914d-4408c17c3df2 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:44.438450 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c87feb76-16f3-4a73-93ff-f222440345f8 req-f10a3f7d-8bb8-4cbe-914d-4408c17c3df2 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 947 time: 0.1989501
Jun 01 10:09:44.472220 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-d587597b-3c32-4586-b14c-0706d3e12190 service neutron] 10.222.0.68 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1645622
Jun 01 10:09:44.494852 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c87feb76-16f3-4a73-93ff-f222440345f8 req-97e09aa9-a2dc-4f0c-9014-407928eedeec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0474310
Jun 01 10:09:44.734604 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e8b3875f-79a0-4bf4-9b25-73e8733c13c1 req-1221b0b1-db06-4ba1-8fd5-531a6714854f tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 210 time: 0.0423753
Jun 01 10:09:45.338613 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a76d03cc-969b-4f70-a40f-ec2599f7ba16 req-7b864d9f-61e4-4b3d-a8df-81482e045bdd tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:45.340196 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a76d03cc-969b-4f70-a40f-ec2599f7ba16 req-7b864d9f-61e4-4b3d-a8df-81482e045bdd tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 945 time: 0.0865974
Jun 01 10:09:45.385107 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a76d03cc-969b-4f70-a40f-ec2599f7ba16 req-1c543a2c-350b-4860-aeee-87ca93a2e5bd tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389998
Jun 01 10:09:45.696560 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a2ad9d-f906-4bc6-b9ab-398c37a46309 req-87fc36d5-3876-42e3-b786-4b3eacb5b56e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:45.698622 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c9a2ad9d-f906-4bc6-b9ab-398c37a46309 req-87fc36d5-3876-42e3-b786-4b3eacb5b56e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 947 time: 0.0881386
Jun 01 10:09:45.755249 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c9a2ad9d-f906-4bc6-b9ab-398c37a46309 req-3557f42a-d0fe-43d7-ab44-8796e27ae0ad tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0503793
Jun 01 10:09:45.766549 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:45.913582 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cde9186e-866f-44f8-908a-0b2d3ff6848e req-71adfb03-0a4d-442d-a42b-c517dbdebd82 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 210 time: 0.0532024
Jun 01 10:09:46.146214 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2502ebe6-64a1-4cad-8830-07a920636c15 req-7aba14ad-a8b6-4bff-b619-a3ba081ce9ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:46.149180 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2502ebe6-64a1-4cad-8830-07a920636c15 req-7aba14ad-a8b6-4bff-b619-a3ba081ce9ad service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 1098 time: 0.0811541
Jun 01 10:09:46.195327 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2502ebe6-64a1-4cad-8830-07a920636c15 req-d1a007d8-2367-461c-a907-b066784b488a service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0393991
Jun 01 10:09:46.582923 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-025b72f7-ec8c-493e-8ff5-bb69b53aaea1 req-a281189b-33d5-4f50-b528-e87b5a782871 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:46.584986 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-025b72f7-ec8c-493e-8ff5-bb69b53aaea1 req-a281189b-33d5-4f50-b528-e87b5a782871 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 945 time: 0.0925732
Jun 01 10:09:46.633860 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-025b72f7-ec8c-493e-8ff5-bb69b53aaea1 req-11e0a390-4925-4e65-8755-216f24f41066 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433128
Jun 01 10:09:46.962435 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12854266-e99c-487a-90ea-0243108055e4 req-3ea216b6-563c-46b1-bfa4-f0597602e2e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:46.964482 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12854266-e99c-487a-90ea-0243108055e4 req-3ea216b6-563c-46b1-bfa4-f0597602e2e6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 947 time: 0.0826969
Jun 01 10:09:47.009819 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12854266-e99c-487a-90ea-0243108055e4 req-19a5878a-2353-4fef-85a4-f0237c951c09 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0394058
Jun 01 10:09:47.074261 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddf2c179-a279-4016-baa6-23f79a19ad91 req-e8aa338a-c190-444b-a122-b7005421fbee tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 210 time: 0.0457091
Jun 01 10:09:47.251064 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f1166ce6-1667-47c9-9ecb-93e46dfdcc95 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:47.252491 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f1166ce6-1667-47c9-9ecb-93e46dfdcc95 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.30 "GET /v2.0/networks?id=95462097-1cc6-4207-9add-1b65afcf40ca HTTP/1.1" status: 200  len: 815 time: 0.1557317
Jun 01 10:09:47.267870 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Request body: {'port': {'device_id': 'f243463c-ee21-4821-9149-223fc68552e4', 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca', 'admin_state_up': True, 'tenant_id': '4f2a9e1dcd084ba7aeb9c96724aea0fe'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:09:47.402836 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:09:47.406852 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Usage tracker for resource:port and tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:09:47.409775 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:09:47.415680 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:09:47.547986 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Made reservation on behalf of 4f2a9e1dcd084ba7aeb9c96724aea0fe for: {'port': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:09:47.551891 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:47.735448 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Allocated IP 172.20.0.3 (95462097-1cc6-4207-9add-1b65afcf40ca/abf69321-90c0-4336-ac76-6ef3766e6a67/6010d8c0-403f-4393-8c5c-fd9cc14aeecb) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:09:48.033461 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ab94337-cea1-4245-a8e6-fe2a9fe6e84a req-3a46181d-09f2-437d-a7e8-537eab91986c tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:48.034925 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3ab94337-cea1-4245-a8e6-fe2a9fe6e84a req-3a46181d-09f2-437d-a7e8-537eab91986c tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 945 time: 0.2867570
Jun 01 10:09:48.115912 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3ab94337-cea1-4245-a8e6-fe2a9fe6e84a req-98b7d347-6a57-419e-aeb9-84e6d874dc82 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0751097
Jun 01 10:09:48.137690 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:48.231860 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-542e662c-cf4f-4074-b4a4-366dd14d904f req-27ad7039-45b8-4750-94aa-f49525d5158e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 210 time: 0.0436935
Jun 01 10:09:48.234780 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:48.241361 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-e1312bdc-719b-4f0c-be9c-8655f230137d tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:48.311073 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Network 95462097-1cc6-4207-9add-1b65afcf40ca is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:09:48.314213 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:09:48.317903 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:09:48.352440 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Pushing event updated for resources: {'Port': ['ID=6010d8c0-403f-4393-8c5c-fd9cc14aeecb,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:48.357389 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:48.385527 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:48.386137 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:48.502343 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.2380323
Jun 01 10:09:48.514852 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Request body: {'port': {'device_id': 'f243463c-ee21-4821-9149-223fc68552e4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:09:48.632318 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:49.012213 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6010d8c0-403f-4393-8c5c-fd9cc14aeecb {{(pid=92566) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:09:49.019978 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:49.036261 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Transition to ACTIVE for port object 6010d8c0-403f-4393-8c5c-fd9cc14aeecb will not be triggered until provisioned by entity L2. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:09:49.102838 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:49.109161 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-12d5251c-456b-494b-83e8-b97a2b216c61 tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:49.259242 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Pushing event updated for resources: {'Port': ['ID=6010d8c0-403f-4393-8c5c-fd9cc14aeecb,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:49.288154 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:49.349060 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7960bcd-ebd1-4612-8a2d-a1b2c024ab21 req-ed57c392-40d2-4f17-a458-f540128213b3 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:49.350545 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b7960bcd-ebd1-4612-8a2d-a1b2c024ab21 req-ed57c392-40d2-4f17-a458-f540128213b3 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.3035967
Jun 01 10:09:49.462996 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Attempting to bind port 6010d8c0-403f-4393-8c5c-fd9cc14aeecb on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:09:49.463336 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Attempting to bind port 6010d8c0-403f-4393-8c5c-fd9cc14aeecb by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': 'f512f187-5724-4ff7-afd5-c422b0bd8ba7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca'}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:09:49.463663 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Attempting to bind port 6010d8c0-403f-4393-8c5c-fd9cc14aeecb on network 95462097-1cc6-4207-9add-1b65afcf40ca {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:09:49.472910 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b7960bcd-ebd1-4612-8a2d-a1b2c024ab21 req-fe605afe-32e3-422a-b792-f7014a23b178 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0818901
Jun 01 10:09:49.477916 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Port 6010d8c0-403f-4393-8c5c-fd9cc14aeecb on network 95462097-1cc6-4207-9add-1b65afcf40ca not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:09:49.477916 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Attempting to bind port 6010d8c0-403f-4393-8c5c-fd9cc14aeecb on network 95462097-1cc6-4207-9add-1b65afcf40ca {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:09:49.485379 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 9, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:09:49.485716 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Checking segment: {'id': 'f512f187-5724-4ff7-afd5-c422b0bd8ba7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:09:49.486101 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Bound using segment: {'id': 'f512f187-5724-4ff7-afd5-c422b0bd8ba7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca'} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:09:49.486538 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Bound port: 6010d8c0-403f-4393-8c5c-fd9cc14aeecb, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f512f187-5724-4ff7-afd5-c422b0bd8ba7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca'}}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:09:49.486937 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:49.545233 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5274008a-832b-4af2-89ac-4a252bd6b302 req-064d994f-e6a7-4efa-9490-eacb91cb041a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:49.545928 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-5274008a-832b-4af2-89ac-4a252bd6b302 req-064d994f-e6a7-4efa-9490-eacb91cb041a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Synchronizing usage tracker for tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:09:49.576234 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34518) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:49.605423 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] For port 6010d8c0-403f-4393-8c5c-fd9cc14aeecb, host hv-cinder-78726, cleared binding levels {{(pid=92566) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:09:49.608451 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] For port 6010d8c0-403f-4393-8c5c-fd9cc14aeecb, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=6010d8c0-403f-4393-8c5c-fd9cc14aeecb,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92566) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:09:49.685795 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-5274008a-832b-4af2-89ac-4a252bd6b302 req-064d994f-e6a7-4efa-9490-eacb91cb041a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Unset dirty status for tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:09:49.687874 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5274008a-832b-4af2-89ac-4a252bd6b302 req-064d994f-e6a7-4efa-9490-eacb91cb041a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 943 time: 0.3339250
Jun 01 10:09:49.694251 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:49.697560 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a8315b4c-b5d9-4a57-ac00-dd1efbdef0d1 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:49.698929 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-e77a2567-9d63-405e-8f83-d029af64c683 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:49.717508 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-e77a2567-9d63-405e-8f83-d029af64c683 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:09:49.721359 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-e77a2567-9d63-405e-8f83-d029af64c683 admin admin] Usage tracker for resource:security_group_rule and tenant:bdfee495d21143b2a199d90dd4dbf35f is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:09:49.724368 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-e77a2567-9d63-405e-8f83-d029af64c683 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:09:49.730829 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-e77a2567-9d63-405e-8f83-d029af64c683 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:09:49.775809 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:49.776408 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:49.778439 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] 10.222.0.30 "PUT /v2.0/ports/6010d8c0-403f-4393-8c5c-fd9cc14aeecb HTTP/1.1" status: 200  len: 1093 time: 1.2670422
Jun 01 10:09:49.778439 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f243463c-ee21-4821-9149-223fc68552e4', 'tag': '6010d8c0-403f-4393-8c5c-fd9cc14aeecb'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:09:49.780609 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d115f873-52a6-4016-a207-4f60abe34651" -d '{"events": [{"name": "network-changed", "server_uuid": "f243463c-ee21-4821-9149-223fc68552e4", "tag": "6010d8c0-403f-4393-8c5c-fd9cc14aeecb"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:09:49.816430 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5274008a-832b-4af2-89ac-4a252bd6b302 req-bf84764c-173a-420a-bbc0-9b397d9e80e3 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1213391
Jun 01 10:09:49.819679 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Pushing event updated for resources: {'Port': ['ID=6010d8c0-403f-4393-8c5c-fd9cc14aeecb,revision_number=3']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:49.822571 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:49.828908 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-e77a2567-9d63-405e-8f83-d029af64c683 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:49.858853 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:09:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-be4de7b8-cf77-476e-9532-5d027d771bff x-openstack-request-id: req-be4de7b8-cf77-476e-9532-5d027d771bff {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:09:49.859195 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f243463c-ee21-4821-9149-223fc68552e4", "tag": "6010d8c0-403f-4393-8c5c-fd9cc14aeecb", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:09:49.859471 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-be4de7b8-cf77-476e-9532-5d027d771bff {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:09:49.859969 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f243463c-ee21-4821-9149-223fc68552e4', 'tag': '6010d8c0-403f-4393-8c5c-fd9cc14aeecb', 'status': 'completed', 'code': 200}
Jun 01 10:09:49.914716 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-e77a2567-9d63-405e-8f83-d029af64c683 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:49.924665 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:49.952547 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-5589351f-2967-46b8-8a1c-497b0a02c181 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:49.953944 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-5589351f-2967-46b8-8a1c-497b0a02c181 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=4f2a9e1dcd084ba7aeb9c96724aea0fe&device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 1096 time: 0.0805197
Jun 01 10:09:49.966856 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-e77a2567-9d63-405e-8f83-d029af64c683 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=bdfee495d21143b2a199d90dd4dbf35f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3894773
Jun 01 10:09:49.967924 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e77a2567-9d63-405e-8f83-d029af64c683 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=16307b21-92dc-4c5b-a66a-10b08ce54d06,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:49.970734 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34536) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:09:49.973279 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-e77a2567-9d63-405e-8f83-d029af64c683 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:50.033173 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c0de67df-3fc9-4611-9670-6730141d258c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:50.037596 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-4668ea94-e9a8-4d75-9135-25aab116d3c3 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=6010d8c0-403f-4393-8c5c-fd9cc14aeecb HTTP/1.1" status: 200  len: 217 time: 0.0754857
Jun 01 10:09:50.060803 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c0de67df-3fc9-4611-9670-6730141d258c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:50.185104 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-c19db929-3dcc-4fbf-a5c3-503c3e662207 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:50.186557 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-c19db929-3dcc-4fbf-a5c3-503c3e662207 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=abf69321-90c0-4336-ac76-6ef3766e6a67 HTTP/1.1" status: 200  len: 855 time: 0.1421111
Jun 01 10:09:50.200571 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c0de67df-3fc9-4611-9670-6730141d258c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:50.212926 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:50.221231 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0de67df-3fc9-4611-9670-6730141d258c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=16307b21-92dc-4c5b-a66a-10b08ce54d06,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:50.227643 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c0de67df-3fc9-4611-9670-6730141d258c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:50.228791 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c0de67df-3fc9-4611-9670-6730141d258c admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:50.232217 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-c0de67df-3fc9-4611-9670-6730141d258c admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/16307b21-92dc-4c5b-a66a-10b08ce54d06 HTTP/1.1" status: 204  len: 168 time: 0.2582858
Jun 01 10:09:50.243655 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-ca5b8a1e-39fc-436c-ad82-e637254920de service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=95462097-1cc6-4207-9add-1b65afcf40ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0496173
Jun 01 10:09:50.388321 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-26324c71-f1c6-4d94-9642-29264dddda4b service neutron] 10.222.0.30 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1294990
Jun 01 10:09:50.534365 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-234c5d30-a76d-4364-b32c-d7f76b0c3083 req-4310a48f-17d2-4d4b-a328-7236a0539a42 service neutron] 10.222.0.30 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1393623
Jun 01 10:09:50.774067 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d115f873-52a6-4016-a207-4f60abe34651 req-2fab91bb-0807-41f7-ab14-067c3ed9c0c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:50.775590 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d115f873-52a6-4016-a207-4f60abe34651 req-2fab91bb-0807-41f7-ab14-067c3ed9c0c5 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=4f2a9e1dcd084ba7aeb9c96724aea0fe&device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 1096 time: 0.1060321
Jun 01 10:09:50.783594 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2de5059f-9e55-4585-bb06-8c4ef37178c1 req-7cc5be68-0518-4c52-ab01-2c317994a428 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:50.784947 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2de5059f-9e55-4585-bb06-8c4ef37178c1 req-7cc5be68-0518-4c52-ab01-2c317994a428 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.1550121
Jun 01 10:09:50.913571 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2de5059f-9e55-4585-bb06-8c4ef37178c1 req-c92bc1df-0eeb-4d4f-8adf-dbfbd1e831b7 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1106369
Jun 01 10:09:51.002489 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d115f873-52a6-4016-a207-4f60abe34651 req-365168b6-a800-4f0b-8e61-d417088878a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:51.003835 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d115f873-52a6-4016-a207-4f60abe34651 req-365168b6-a800-4f0b-8e61-d417088878a2 service neutron] 10.222.0.30 "GET /v2.0/networks?id=95462097-1cc6-4207-9add-1b65afcf40ca HTTP/1.1" status: 200  len: 916 time: 0.2180629
Jun 01 10:09:51.077012 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d115f873-52a6-4016-a207-4f60abe34651 req-dd41e13a-2a3c-417f-8f3e-7915af7ccde5 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=6010d8c0-403f-4393-8c5c-fd9cc14aeecb HTTP/1.1" status: 200  len: 217 time: 0.0652118
Jun 01 10:09:51.137461 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15352c7e-74e8-4f32-be64-0c53525b6213 req-6a0d261e-7b12-4a87-86a2-0856bbc8ddf5 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:51.138885 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-15352c7e-74e8-4f32-be64-0c53525b6213 req-6a0d261e-7b12-4a87-86a2-0856bbc8ddf5 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 943 time: 0.2031353
Jun 01 10:09:51.167603 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d115f873-52a6-4016-a207-4f60abe34651 req-7db3d72e-a9a5-4e35-b525-e3d825559ef9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:51.168971 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d115f873-52a6-4016-a207-4f60abe34651 req-7db3d72e-a9a5-4e35-b525-e3d825559ef9 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=abf69321-90c0-4336-ac76-6ef3766e6a67 HTTP/1.1" status: 200  len: 855 time: 0.0843759
Jun 01 10:09:51.233575 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-15352c7e-74e8-4f32-be64-0c53525b6213 req-7eae6580-6549-4116-b81e-1487fd1a30c5 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0881779
Jun 01 10:09:51.239928 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d115f873-52a6-4016-a207-4f60abe34651 req-3ed9f660-be97-48a7-b9ec-76b956dc6ed8 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=95462097-1cc6-4207-9add-1b65afcf40ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0547161
Jun 01 10:09:51.376140 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d115f873-52a6-4016-a207-4f60abe34651 req-50a6b45e-4653-472e-a0f0-6037909b79f6 service neutron] 10.222.0.30 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1296952
Jun 01 10:09:51.512714 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d115f873-52a6-4016-a207-4f60abe34651 req-87cf3113-4d8c-4231-a863-546661939e36 service neutron] 10.222.0.30 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1298730
Jun 01 10:09:52.102574 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcbb0339-12cf-4e51-9a56-b983e26260ea req-4bed8b1a-10a5-434d-b4a6-1a574ec4b04d tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:52.104345 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bcbb0339-12cf-4e51-9a56-b983e26260ea req-4bed8b1a-10a5-434d-b4a6-1a574ec4b04d tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0818982
Jun 01 10:09:52.151414 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bcbb0339-12cf-4e51-9a56-b983e26260ea req-557ab2db-5b29-4a33-ba73-4ca04f13765b tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0411980
Jun 01 10:09:52.427323 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f56abdce-2a0a-451c-a6b6-442d0af5ebe5 req-213e06eb-8721-41d5-8901-bbdfb6cb7755 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:52.428846 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f56abdce-2a0a-451c-a6b6-442d0af5ebe5 req-213e06eb-8721-41d5-8901-bbdfb6cb7755 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 943 time: 0.0856912
Jun 01 10:09:52.475067 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f56abdce-2a0a-451c-a6b6-442d0af5ebe5 req-4bced712-e2ac-4152-b343-c90cb6be4d8a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397160
Jun 01 10:09:53.342118 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2dd40d1-3331-4086-9da9-5e72bb5289a0 req-c4b7e61a-3d39-4b0a-a5db-baa99a5e0251 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:53.343613 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d2dd40d1-3331-4086-9da9-5e72bb5289a0 req-c4b7e61a-3d39-4b0a-a5db-baa99a5e0251 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0822885
Jun 01 10:09:53.472190 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d2dd40d1-3331-4086-9da9-5e72bb5289a0 req-74dfb92f-f449-4c5e-b0cb-d355343b7c45 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1207690
Jun 01 10:09:53.661148 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cb58d7e-3621-48be-92d5-1686e41cefa6 req-5e957a6d-548d-402f-b0c7-3349947c4cc5 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:53.662671 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5cb58d7e-3621-48be-92d5-1686e41cefa6 req-5e957a6d-548d-402f-b0c7-3349947c4cc5 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 943 time: 0.0807302
Jun 01 10:09:53.709535 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5cb58d7e-3621-48be-92d5-1686e41cefa6 req-febad55b-ca9a-47b2-96ad-a287c47c47ce tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394926
Jun 01 10:09:54.175313 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 6010d8c0-403f-4393-8c5c-fd9cc14aeecb details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:09:54.343142 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 6010d8c0-403f-4393-8c5c-fd9cc14aeecb, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=6010d8c0-403f-4393-8c5c-fd9cc14aeecb,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:09:54.356473 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': '6010d8c0-403f-4393-8c5c-fd9cc14aeecb', 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca', 'port_id': '6010d8c0-403f-4393-8c5c-fd9cc14aeecb', 'mac_address': 'fa:16:3e:44:3f:b3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 897, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'abf69321-90c0-4336-ac76-6ef3766e6a67', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:09:54.411627 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:54.428971 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6010d8c0-403f-4393-8c5c-fd9cc14aeecb {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:09:54.444248 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 6010d8c0-403f-4393-8c5c-fd9cc14aeecb, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=6010d8c0-403f-4393-8c5c-fd9cc14aeecb,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:09:54.530068 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:54.532203 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:09:54.603973 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=6010d8c0-403f-4393-8c5c-fd9cc14aeecb,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:09:54.607579 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:09:54.665326 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3069ab-1725-4993-ab98-e86b6da20d09 req-1520ba06-4ded-46f4-8b54-b8c8a6206ba0 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:54.667431 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ab3069ab-1725-4993-ab98-e86b6da20d09 req-1520ba06-4ded-46f4-8b54-b8c8a6206ba0 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0868652
Jun 01 10:09:54.715655 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ab3069ab-1725-4993-ab98-e86b6da20d09 req-b85d492c-2860-49f2-8d8e-1aef5f7cc098 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0425038
Jun 01 10:09:54.898680 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed32a9c1-9907-4718-8688-4ad04859cb3d req-166cd4bb-59f3-4817-ad8e-2f8bfa6620db tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:54.900162 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ed32a9c1-9907-4718-8688-4ad04859cb3d req-166cd4bb-59f3-4817-ad8e-2f8bfa6620db tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 944 time: 0.0821152
Jun 01 10:09:54.946366 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ed32a9c1-9907-4718-8688-4ad04859cb3d req-991b1630-529f-441c-b239-ae31baa46293 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398929
Jun 01 10:09:55.903054 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a58a94db-e44e-4e9a-af9e-7d9f0a4a0e61 req-f7a5f281-ff5c-4d1e-b7bd-31fc15e1c800 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:55.904411 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a58a94db-e44e-4e9a-af9e-7d9f0a4a0e61 req-f7a5f281-ff5c-4d1e-b7bd-31fc15e1c800 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0827069
Jun 01 10:09:55.949083 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a58a94db-e44e-4e9a-af9e-7d9f0a4a0e61 req-b000e970-aef9-43d0-b0c9-87a59eb0e217 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0387073
Jun 01 10:09:56.134175 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-008c54a2-23af-4d57-b0b5-18923c355a45 req-fde9ef6e-2f3f-4d22-84e9-7af3eeb39208 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:56.135700 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-008c54a2-23af-4d57-b0b5-18923c355a45 req-fde9ef6e-2f3f-4d22-84e9-7af3eeb39208 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 944 time: 0.0835402
Jun 01 10:09:56.155566 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:09:56.185274 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-008c54a2-23af-4d57-b0b5-18923c355a45 req-7968915b-2a47-431e-9bdf-885206539dbd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0437996
Jun 01 10:09:57.135477 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d4cc6f2-2d76-46f6-8fdf-c27572252fc7 req-f39ca8bb-1dae-4bfc-b18e-6177a5f1b72c tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:57.137055 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3d4cc6f2-2d76-46f6-8fdf-c27572252fc7 req-f39ca8bb-1dae-4bfc-b18e-6177a5f1b72c tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0809517
Jun 01 10:09:57.180994 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3d4cc6f2-2d76-46f6-8fdf-c27572252fc7 req-d2a141de-e0e2-497d-998b-041735e919ef tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0381708
Jun 01 10:09:57.384106 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3782ab01-ea0e-454a-bbdb-f40458adfc73 req-68ac576e-4d26-47a2-98b0-179e1f844e7a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:57.385581 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3782ab01-ea0e-454a-bbdb-f40458adfc73 req-68ac576e-4d26-47a2-98b0-179e1f844e7a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 944 time: 0.0913086
Jun 01 10:09:57.433020 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3782ab01-ea0e-454a-bbdb-f40458adfc73 req-ff496c44-8b3c-4954-b22c-b68c803a8672 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418739
Jun 01 10:09:57.845344 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['6010d8c0-403f-4393-8c5c-fd9cc14aeecb'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:09:58.371099 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3730f15-7013-49fa-85da-c72a3f1abfe8 req-a84b7052-c525-40fb-9a92-eac61697b60e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:58.372565 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b3730f15-7013-49fa-85da-c72a3f1abfe8 req-a84b7052-c525-40fb-9a92-eac61697b60e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0834093
Jun 01 10:09:58.418688 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b3730f15-7013-49fa-85da-c72a3f1abfe8 req-c6e554dd-89a0-4bb5-ad5d-fc5e32fbd2b4 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405679
Jun 01 10:09:58.471389 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:09:58.628335 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a905f52-f192-4b5d-902b-c52993e4fe47 req-1a2ed53b-1c40-4a0d-9db6-0db555ce4e72 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:58.629803 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3a905f52-f192-4b5d-902b-c52993e4fe47 req-1a2ed53b-1c40-4a0d-9db6-0db555ce4e72 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 944 time: 0.0860798
Jun 01 10:09:58.674732 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3a905f52-f192-4b5d-902b-c52993e4fe47 req-b6f7578b-5161-482d-b4cd-e5f411662b78 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392859
Jun 01 10:09:59.604619 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ea2a98b-6b37-4057-9ff9-0912e447702a req-3dfb26d4-4a3c-49ed-baf5-6d4e6088d41a tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:59.606065 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8ea2a98b-6b37-4057-9ff9-0912e447702a req-3dfb26d4-4a3c-49ed-baf5-6d4e6088d41a tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0823820
Jun 01 10:09:59.657685 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8ea2a98b-6b37-4057-9ff9-0912e447702a req-5a691d0b-3589-4ba2-8ae1-45aa90f17a7d tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0459759
Jun 01 10:09:59.862582 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5570dd-cee3-449f-8893-00d2ec2facee req-afc02cf2-8d73-4a76-838f-60cf8f7f1649 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:09:59.864331 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2e5570dd-cee3-449f-8893-00d2ec2facee req-afc02cf2-8d73-4a76-838f-60cf8f7f1649 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 944 time: 0.0832388
Jun 01 10:09:59.913350 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2e5570dd-cee3-449f-8893-00d2ec2facee req-d34bbed6-57f0-4d2d-9983-707af13b663c tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0432889
Jun 01 10:10:00.200158 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 6010d8c0-403f-4393-8c5c-fd9cc14aeecb up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:10:00.320018 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port 6010d8c0-403f-4393-8c5c-fd9cc14aeecb completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:10:00.325307 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port 6010d8c0-403f-4393-8c5c-fd9cc14aeecb triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:00.329950 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:00.455664 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:00.485719 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f243463c-ee21-4821-9149-223fc68552e4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6010d8c0-403f-4393-8c5c-fd9cc14aeecb'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:10:00.487967 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fc68ae01-dd1b-46f4-959b-1a7212d9b5b5" -d '{"events": [{"server_uuid": "f243463c-ee21-4821-9149-223fc68552e4", "name": "network-vif-plugged", "status": "completed", "tag": "6010d8c0-403f-4393-8c5c-fd9cc14aeecb"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:10:00.496694 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 6010d8c0-403f-4393-8c5c-fd9cc14aeecb, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=6010d8c0-403f-4393-8c5c-fd9cc14aeecb,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:10:00.529301 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:10:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9417879b-b37b-4b71-97ac-ef49a65a7bbd x-openstack-request-id: req-9417879b-b37b-4b71-97ac-ef49a65a7bbd {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:10:00.529580 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f243463c-ee21-4821-9149-223fc68552e4", "name": "network-vif-plugged", "status": "completed", "tag": "6010d8c0-403f-4393-8c5c-fd9cc14aeecb", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:10:00.529833 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-9417879b-b37b-4b71-97ac-ef49a65a7bbd {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:10:00.530219 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f243463c-ee21-4821-9149-223fc68552e4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6010d8c0-403f-4393-8c5c-fd9cc14aeecb', 'code': 200}
Jun 01 10:10:00.588973 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:00.591570 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-36a7db33-a748-4db9-aea5-0991ee90be02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:00.659935 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=6010d8c0-403f-4393-8c5c-fd9cc14aeecb,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:00.667797 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:00.668130 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:00.668458 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:00.668952 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:00.669278 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:00.669597 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:00.669914 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:00.670229 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:00.670553 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:00.670866 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:00.671206 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:00.671518 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:00.675275 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:00.898844 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-735a7f49-ff04-4736-9016-a45cd75e4419 req-7fec6723-8372-4d9f-9d17-1e99c25ef9e0 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:00.900249 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-735a7f49-ff04-4736-9016-a45cd75e4419 req-7fec6723-8372-4d9f-9d17-1e99c25ef9e0 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.1343331
Jun 01 10:10:00.944415 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cb12bdb-1c49-4b45-b386-37345584adb2 req-0ff0cab6-63f6-43e9-8229-a02cd69eb052 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:00.946007 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9cb12bdb-1c49-4b45-b386-37345584adb2 req-0ff0cab6-63f6-43e9-8229-a02cd69eb052 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 1098 time: 0.1159005
Jun 01 10:10:00.956930 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-735a7f49-ff04-4736-9016-a45cd75e4419 req-eacb6fe7-5998-4ae7-bd20-f97413712a2d tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0493221
Jun 01 10:10:00.993085 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9cb12bdb-1c49-4b45-b386-37345584adb2 req-4b932347-1be2-4f30-bd3b-46b970823e94 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0393100
Jun 01 10:10:01.106225 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83053a46-e058-49a6-9958-98e46ecb33de req-493c8cdc-3492-41dc-8333-96a131028db2 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:01.107852 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-83053a46-e058-49a6-9958-98e46ecb33de req-493c8cdc-3492-41dc-8333-96a131028db2 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 945 time: 0.0865161
Jun 01 10:10:01.152534 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-83053a46-e058-49a6-9958-98e46ecb33de req-70048238-7ea3-4157-8d41-b2f51c759d14 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0380783
Jun 01 10:10:02.152727 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2dbc3fc-9058-4bc9-9ce5-6c74530ed924 req-1584a261-f459-49ff-91b0-c0c75ef15b2d tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:02.154164 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e2dbc3fc-9058-4bc9-9ce5-6c74530ed924 req-1584a261-f459-49ff-91b0-c0c75ef15b2d tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0845711
Jun 01 10:10:02.205183 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e2dbc3fc-9058-4bc9-9ce5-6c74530ed924 req-3f5cd9df-5ef9-4e64-a386-d454a42e6ad7 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0451560
Jun 01 10:10:02.489764 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-343fbc05-7078-42ca-8092-02cb507eb3b7 req-ade630ea-a163-426a-b668-27c24ba69f55 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:02.491228 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-343fbc05-7078-42ca-8092-02cb507eb3b7 req-ade630ea-a163-426a-b668-27c24ba69f55 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 945 time: 0.0807309
Jun 01 10:10:02.535798 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-343fbc05-7078-42ca-8092-02cb507eb3b7 req-86f61268-6985-4540-b037-9ba8d6a5bb8b tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382395
Jun 01 10:10:03.398460 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d32c2195-3822-4956-9a3e-c813fc946676 req-3c8ebe68-619a-4fed-928e-cf902c75e605 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:03.399993 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d32c2195-3822-4956-9a3e-c813fc946676 req-3c8ebe68-619a-4fed-928e-cf902c75e605 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0897775
Jun 01 10:10:03.443764 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d32c2195-3822-4956-9a3e-c813fc946676 req-e9ff6f64-59f4-49bb-b5bd-651ff2a2145a tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0380285
Jun 01 10:10:03.716852 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a79fab9f-d9dc-4e2d-9b22-7d3753d384fc req-58ce78d5-cdab-480f-8415-a5bde2278ec6 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:03.718308 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a79fab9f-d9dc-4e2d-9b22-7d3753d384fc req-58ce78d5-cdab-480f-8415-a5bde2278ec6 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 945 time: 0.0785885
Jun 01 10:10:03.764505 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a79fab9f-d9dc-4e2d-9b22-7d3753d384fc req-ca71dac6-213c-40a5-8518-dfeca5a0d684 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405509
Jun 01 10:10:04.624775 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34692) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:04.719451 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e137b137-309b-4735-9bf3-c215de241dcb req-788878fd-0764-43d8-9f8f-a3be4f50d2e8 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:04.722207 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e137b137-309b-4735-9bf3-c215de241dcb req-788878fd-0764-43d8-9f8f-a3be4f50d2e8 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.1694775
Jun 01 10:10:04.770855 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e137b137-309b-4735-9bf3-c215de241dcb req-db663b90-a1a1-42f1-9859-1c79b2033a9e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0424087
Jun 01 10:10:04.771168 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:04.807245 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:04.807245 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Usage tracker for resource:security_group_rule and tenant:869eace7149948c7ae0cf51cbd10e6b3 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:04.807245 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:04.807245 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:04.884065 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:04.960023 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:04.969092 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b528f053-81bd-4896-b5ce-cac398b072ce admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:05.008979 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=869eace7149948c7ae0cf51cbd10e6b3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3830736
Jun 01 10:10:05.010582 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c5418b4-04f7-4cd6-8c8a-de9746e6e3c4,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:05.011777 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 34702) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:05.018620 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:05.019021 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:05.019385 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:05.019744 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:05.020095 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:05.020444 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:05.020792 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:05.021138 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:05.021486 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:05.021835 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:05.022177 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:05.022518 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:05.026432 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:05.072224 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-0842d006-14ac-42e6-81c0-382339330fd9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:05.098784 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-0842d006-14ac-42e6-81c0-382339330fd9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:05.228647 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-0842d006-14ac-42e6-81c0-382339330fd9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:05.234051 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-36d784ec-dccc-47ab-adc7-8b61133b7c29 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:05.245681 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0842d006-14ac-42e6-81c0-382339330fd9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c5418b4-04f7-4cd6-8c8a-de9746e6e3c4,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:05.250273 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-0842d006-14ac-42e6-81c0-382339330fd9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:05.251506 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-0842d006-14ac-42e6-81c0-382339330fd9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:05.252603 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-0842d006-14ac-42e6-81c0-382339330fd9 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/1c5418b4-04f7-4cd6-8c8a-de9746e6e3c4 HTTP/1.1" status: 204  len: 168 time: 0.2392709
Jun 01 10:10:05.955296 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61eb01b3-b923-4db7-aa22-681c48e1dd7a req-f504614f-1aaa-437e-a71a-2ee63248b2b8 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:05.956756 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-61eb01b3-b923-4db7-aa22-681c48e1dd7a req-f504614f-1aaa-437e-a71a-2ee63248b2b8 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0820298
Jun 01 10:10:06.005648 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-61eb01b3-b923-4db7-aa22-681c48e1dd7a req-129ff398-e146-421c-843c-799441dd1a28 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0432949
Jun 01 10:10:06.289487 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 34738) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:06.401956 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-4490896-network', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:06.406562 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:06.410442 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Usage tracker for resource:network and tenant:cfa9132b1ba044548228b96f6c2755eb is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:06.417645 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:06.419511 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:06.520059 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Made reservation on behalf of cfa9132b1ba044548228b96f6c2755eb for: {'network': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:10:06.524364 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:06.539031 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:06.556350 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:06.561228 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Usage tracker for resource:security_group_rule and tenant:cfa9132b1ba044548228b96f6c2755eb is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:06.564046 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:06.575588 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:06.644377 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee13ec33-f232-4f48-a828-00b1c2b14bb8 req-8841e959-5182-44e8-8077-ef08af7317c5 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:06.645811 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ee13ec33-f232-4f48-a828-00b1c2b14bb8 req-8841e959-5182-44e8-8077-ef08af7317c5 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.1876040
Jun 01 10:10:06.724494 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ee13ec33-f232-4f48-a828-00b1c2b14bb8 req-deb5dad0-d61b-44dc-bf42-7991437afce6 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0721042
Jun 01 10:10:06.770405 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b168769-e5cd-40fb-a8cf-9bc942700e2b req-6b5bc4ae-0fe6-46f2-b1b8-92fb2d6b3297 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:06.771885 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3b168769-e5cd-40fb-a8cf-9bc942700e2b req-6b5bc4ae-0fe6-46f2-b1b8-92fb2d6b3297 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=d13dc1de700d428a8982ca87f11948d0&device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 1098 time: 0.1808639
Jun 01 10:10:06.778861 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:06.856591 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:06.862519 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1e818cc1-effc-418f-b88f-273266c2838f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:06.916757 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 857}  {{(pid=92566) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:10:06.919730 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=42eb0609-06e4-4793-b5e9-657f749cb27b,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:06.947723 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:06.948089 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:06.948443 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:06.948791 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:06.949133 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:06.949497 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:06.949845 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:06.950184 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:06.950527 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:06.950860 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:06.951263 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:06.951625 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:06.958200 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:06.958840 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.segments_db [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Added segment fa0b3f88-fc98-4047-ba13-b4db68c2afa1 of type vlan for network 83aff072-8820-4a36-b8f3-036a7011aace
Jun 01 10:10:06.959718 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:06.965849 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b168769-e5cd-40fb-a8cf-9bc942700e2b req-1a2dc908-c1e1-4c30-944e-e051cca015a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:06.968126 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3b168769-e5cd-40fb-a8cf-9bc942700e2b req-1a2dc908-c1e1-4c30-944e-e051cca015a3 service neutron] 10.222.0.30 "GET /v2.0/networks?id=3d9ff4d3-b145-4108-a593-976a9cfb63dc HTTP/1.1" status: 200  len: 911 time: 0.1880436
Jun 01 10:10:07.058310 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:07.114241 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3b168769-e5cd-40fb-a8cf-9bc942700e2b req-38c6b68d-833d-4706-9660-903054b53acb service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 HTTP/1.1" status: 200  len: 1000 time: 0.1253109
Jun 01 10:10:07.174938 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b168769-e5cd-40fb-a8cf-9bc942700e2b req-77abcdc3-cb7c-4bb4-b54d-4f2871684e3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:07.176351 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3b168769-e5cd-40fb-a8cf-9bc942700e2b req-77abcdc3-cb7c-4bb4-b54d-4f2871684e3c service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2a00a573-a4bb-4d2d-a3e6-7aef03966618 HTTP/1.1" status: 200  len: 849 time: 0.0593600
Jun 01 10:10:07.184141 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:07.185438 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:07.186012 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:07.191020 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:07.339283 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Pushing event updated for resources: {'Network': ['ID=83aff072-8820-4a36-b8f3-036a7011aace,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:07.343143 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:07.353933 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network 83aff072-8820-4a36-b8f3-036a7011aace details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:10:07.367837 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b168769-e5cd-40fb-a8cf-9bc942700e2b req-dd45863d-5010-4654-a84b-94022299675c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:07.369422 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3b168769-e5cd-40fb-a8cf-9bc942700e2b req-dd45863d-5010-4654-a84b-94022299675c service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=3d9ff4d3-b145-4108-a593-976a9cfb63dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1638815
Jun 01 10:10:07.454917 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 1.1642644
Jun 01 10:10:07.458620 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34762) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:07.474226 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-ba3768de-0679-4ec2-8e63-d052c2a3034f admin admin] Request body: {'subnet': {'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-4490896-subnet', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'ip_version': 4}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:07.479133 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-ba3768de-0679-4ec2-8e63-d052c2a3034f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:07.483124 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-ba3768de-0679-4ec2-8e63-d052c2a3034f admin admin] Usage tracker for resource:subnet and tenant:cfa9132b1ba044548228b96f6c2755eb is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:07.486028 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-ba3768de-0679-4ec2-8e63-d052c2a3034f admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:07.492751 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-ba3768de-0679-4ec2-8e63-d052c2a3034f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:07.521509 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3b168769-e5cd-40fb-a8cf-9bc942700e2b req-a6b850d5-1ad7-4086-931a-0fe8b05e17fa service neutron] 10.222.0.30 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1409841
Jun 01 10:10:07.605782 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ba3768de-0679-4ec2-8e63-d052c2a3034f admin admin] Made reservation on behalf of cfa9132b1ba044548228b96f6c2755eb for: {'subnet': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:10:07.608155 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ba3768de-0679-4ec2-8e63-d052c2a3034f admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3139364'] for subnet, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:07.660548 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3b168769-e5cd-40fb-a8cf-9bc942700e2b req-4280066a-4f52-4054-923e-57fbe3f7551f service neutron] 10.222.0.30 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1307032
Jun 01 10:10:07.923221 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47d982fd-1557-4845-a43e-7618475fb4c2 req-eff33f3b-1a0c-4c34-9528-0f0e8d512a29 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:07.924708 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47d982fd-1557-4845-a43e-7618475fb4c2 req-eff33f3b-1a0c-4c34-9528-0f0e8d512a29 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0808589
Jun 01 10:10:07.968835 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47d982fd-1557-4845-a43e-7618475fb4c2 req-ed3bc066-c149-41e8-bca6-630d3e4531cd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0383568
Jun 01 10:10:08.077635 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ba3768de-0679-4ec2-8e63-d052c2a3034f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2233128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3139378'] for subnet, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:08.081548 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:08.150945 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba3768de-0679-4ec2-8e63-d052c2a3034f admin admin] Pushing event updated for resources: {'Subnet': ['ID=38dbf18a-9bde-4c4a-b149-d02ad12671d3,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:08.155812 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-ba3768de-0679-4ec2-8e63-d052c2a3034f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:08.166202 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba3768de-0679-4ec2-8e63-d052c2a3034f admin admin] Checking segment: {'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92565) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:10:08.166568 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba3768de-0679-4ec2-8e63-d052c2a3034f admin admin] Network hostable DHCP agents. Network: 83aff072-8820-4a36-b8f3-036a7011aace, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92565) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:10:08.269075 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba3768de-0679-4ec2-8e63-d052c2a3034f admin admin] Network 83aff072-8820-4a36-b8f3-036a7011aace is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92565) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:10:08.365497 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-ba3768de-0679-4ec2-8e63-d052c2a3034f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, 83aff072-8820-4a36-b8f3-036a7011aace) {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:10:08.382234 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f79a2291-baaa-4a26-85ac-2d787917ae3f None None] Network 83aff072-8820-4a36-b8f3-036a7011aace requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:10:08.382804 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba3768de-0679-4ec2-8e63-d052c2a3034f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:08.382804 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ba3768de-0679-4ec2-8e63-d052c2a3034f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:08.475267 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-ba3768de-0679-4ec2-8e63-d052c2a3034f admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.0129902
Jun 01 10:10:08.477898 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34774) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:08.483528 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:08.491137 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:08.492155 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Usage tracker for resource:router and tenant:cfa9132b1ba044548228b96f6c2755eb is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:08.495017 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:08.501388 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:08.577265 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-405701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15802'] for router, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:08.578320 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-407493', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-403482', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-465655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-15793'] for router, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:08.592781 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ec86312-457d-532c-ad41-c4edfccc592e-83aff072-8820-4a36-b8f3-036a7011aace', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3'}]}} from dv-cinder-787262-4-iscsi. {{(pid=92567) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 10:10:08.593660 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:08.594799 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:08.750679 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.db_base_plugin_common [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Allocated IP 172.20.0.2 (83aff072-8820-4a36-b8f3-036a7011aace/38dbf18a-9bde-4c4a-b149-d02ad12671d3/39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b) {{(pid=92567) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:10:08.940471 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-403519', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-405751', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-15815'] for router, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:08.958705 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Notify callbacks [] for port, precommit_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:08.969085 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Transition to ACTIVE for port object 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:10:08.986371 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Transition to ACTIVE for port object 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b will not be triggered until provisioned by entity DHCP. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:10:09.067917 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:09.073045 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:09.146569 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Network 83aff072-8820-4a36-b8f3-036a7011aace is already hosted by enough agents. {{(pid=92567) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:10:09.152500 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.base_scheduler [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Resources bound (agent type, host, resource id):  {{(pid=92567) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:10:09.157037 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Received port after_create {{(pid=92567) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:10:09.173762 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-472286fd-7522-4ecb-8179-5674b4368749 req-a2829f6c-c302-4844-853c-3bf21bd4dfc0 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:09.175497 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-472286fd-7522-4ecb-8179-5674b4368749 req-a2829f6c-c302-4844-853c-3bf21bd4dfc0 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0963073
Jun 01 10:10:09.197857 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Pushing event updated for resources: {'Port': ['ID=39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b,revision_number=1']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:09.202082 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:09.227965 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-472286fd-7522-4ecb-8179-5674b4368749 req-58255f0d-1057-43af-b41b-e7c44942067e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0440860
Jun 01 10:10:09.439936 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:09.470461 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:09.608423 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Allocated IP 172.27.2.200 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/b61f43ed-7118-4cdc-b650-27da1d3644ed) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:10:09.620050 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Attempting to bind port 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:10:09.620592 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Attempting to bind port 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:10:09.620759 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Attempting to bind port 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b on network 83aff072-8820-4a36-b8f3-036a7011aace {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:10:09.626797 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 9, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:10:09.627199 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Checking segment: {'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:10:09.627684 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:09.628073 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Bound using segment: {'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:10:09.628531 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Bound port: 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:10:09.628904 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:09.717398 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] For port 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:10:09.720348 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] For port 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:10:09.759530 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:09.817408 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:09.821949 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:09.851680 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:09.857176 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:09.895978 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Pushing event updated for resources: {'Port': ['ID=39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:09.899255 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:09.929710 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:10:09.932902 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:10:09.937383 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:10:09.973080 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Pushing event updated for resources: {'Port': ['ID=b61f43ed-7118-4cdc-b650-27da1d3644ed,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:09.977567 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:10.422979 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:10.455613 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-a418f85d-0ff9-4282-98bc-52931da08900 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:10.770398 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-405708', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-403580'] for router, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:10.786077 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-113f2978-dc48-4f5e-946d-9d2ae60d7428 None None] Network 83aff072-8820-4a36-b8f3-036a7011aace requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:10:10.967239 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7607feb4-4302-41a2-a11c-c4781f79606a None None] Provisioning for port 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:10:11.165786 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Router 426524f6-17bf-45cb-b42b-2fec9e039ff0 is scheduled to L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c with binding_index 1 {{(pid=92565) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 10:10:11.349827 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:10:11.359051 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Sync routers for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:10:11.368211 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:10:11.368814 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7299d640>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:09:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:11.423150 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Notify callbacks [] for router, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:11.424802 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] 10.222.0.68 "POST /v2.0/routers HTTP/1.1" status: 201  len: 921 time: 2.9459665
Jun 01 10:10:11.429031 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34794) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:11.559350 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:10:11.607255 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:10:11.893322 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:10:11.900157 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:11.900532 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:11.946767 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7299d640>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:10Z', 'revision_number': 3, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:11.956607 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Checking router: 426524f6-17bf-45cb-b42b-2fec9e039ff0 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:10:11.956968 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Updating router 426524f6-17bf-45cb-b42b-2fec9e039ff0 port b61f43ed-7118-4cdc-b650-27da1d3644ed binding host dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:10:12.016630 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:12.101440 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:12.173073 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:12.283400 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:10:12.315237 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Allocated IP 172.20.0.1 (83aff072-8820-4a36-b8f3-036a7011aace/38dbf18a-9bde-4c4a-b149-d02ad12671d3/f5cd5bf7-9718-4375-b561-e61f796ff6b8) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:10:12.358521 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:12.362519 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:12.465799 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:12.481024 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.provisioning_blocks [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Transition to ACTIVE for port object f5cd5bf7-9718-4375-b561-e61f796ff6b8 will not be triggered until provisioned by entity DHCP. {{(pid=92565) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:10:12.485165 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Notify callbacks [] for port, precommit_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:12.487584 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:12.492140 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:12.504293 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Transition to ACTIVE for port object b61f43ed-7118-4cdc-b650-27da1d3644ed will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:10:12.599381 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:12.603247 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:12.629107 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:12.633778 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a449e129-1e4c-4115-ab05-ecb15ef941e8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:12.679844 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Attempting to bind port b61f43ed-7118-4cdc-b650-27da1d3644ed on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:10:12.680217 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Attempting to bind port b61f43ed-7118-4cdc-b650-27da1d3644ed by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:10:12.680590 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Attempting to bind port b61f43ed-7118-4cdc-b650-27da1d3644ed on network a961b732-0873-4e86-af5a-7e84ae1a2549 {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:10:12.683973 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51016dd6-9ce7-4719-8969-8720768c553b None None] Pushing event updated for resources: {'Port': ['ID=b61f43ed-7118-4cdc-b650-27da1d3644ed,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:12.688394 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-51016dd6-9ce7-4719-8969-8720768c553b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:12.689837 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 9, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:10:12.690210 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Checking segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:10:12.690615 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:12.691034 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Bound using segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:10:12.691625 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Bound port: b61f43ed-7118-4cdc-b650-27da1d3644ed, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:10:12.691864 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:12.694003 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Network 83aff072-8820-4a36-b8f3-036a7011aace is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:10:12.696929 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:10:12.700687 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:10:12.753019 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Pushing event updated for resources: {'Port': ['ID=f5cd5bf7-9718-4375-b561-e61f796ff6b8,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:12.757308 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:12.776509 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-401677'] for router_interface, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:12.806038 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] For port b61f43ed-7118-4cdc-b650-27da1d3644ed, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:10:12.810577 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] For port b61f43ed-7118-4cdc-b650-27da1d3644ed, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=b61f43ed-7118-4cdc-b650-27da1d3644ed,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:10:12.886121 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:12.889853 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:12.958897 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-01b899bd-513b-4dc8-822a-5ed1950d7ee4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:12.980494 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:10:12.981545 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7299d640>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:10:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:13.046843 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-2f69fb51-bea2-4fcb-89ee-49b5ee48066e None None] Provisioning for port f5cd5bf7-9718-4375-b561-e61f796ff6b8 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:10:13.060982 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51016dd6-9ce7-4719-8969-8720768c553b None None] Pushing event updated for resources: {'Port': ['ID=b61f43ed-7118-4cdc-b650-27da1d3644ed,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:13.064194 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-51016dd6-9ce7-4719-8969-8720768c553b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:13.067604 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-2f69fb51-bea2-4fcb-89ee-49b5ee48066e None None] Provisioning complete for port f5cd5bf7-9718-4375-b561-e61f796ff6b8 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:13.068051 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-2f69fb51-bea2-4fcb-89ee-49b5ee48066e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:13.212478 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-2f69fb51-bea2-4fcb-89ee-49b5ee48066e None None] Port f5cd5bf7-9718-4375-b561-e61f796ff6b8 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:10:13.214398 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:13.235704 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:10:13.335863 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:13.436940 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:13.503228 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2295697'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:13.529013 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7299d640>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:10Z', 'revision_number': 3, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:13.536333 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:13.536441 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c944df8-8047-480b-b785-a417d95ec56c None None] The sync data for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi is: [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:10Z', 'revision_number': 3, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:10:13.537328 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:10:13.619646 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7873030', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-401824'] for router_interface, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:13.623099 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:13.623099 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:13.623498 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Pushing event updated for resources: {'Port': ['ID=f5cd5bf7-9718-4375-b561-e61f796ff6b8,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:13.627049 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:13.773397 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Network 83aff072-8820-4a36-b8f3-036a7011aace is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:10:13.774528 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:10:13.989184 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Router 426524f6-17bf-45cb-b42b-2fec9e039ff0 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:10:14.038026 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:14.045777 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-80df9017-be03-471a-b822-bc73527ed710 None None] Provisioning complete for port f5cd5bf7-9718-4375-b561-e61f796ff6b8 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:14.046151 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-80df9017-be03-471a-b822-bc73527ed710 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:14.104798 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-80df9017-be03-471a-b822-bc73527ed710 None None] Port f5cd5bf7-9718-4375-b561-e61f796ff6b8 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:10:14.176442 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:10:14.190952 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] 10.222.0.68 "PUT /v2.0/routers/426524f6-17bf-45cb-b42b-2fec9e039ff0/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7580450
Jun 01 10:10:14.986596 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34834) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:14.992871 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-871855271-network', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:14.998646 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:15.003145 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Usage tracker for resource:network and tenant:1357a99c386544928f00bd66b4f5a21b is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:15.007297 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:15.013920 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:15.085607 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Made reservation on behalf of 1357a99c386544928f00bd66b4f5a21b for: {'network': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:10:15.088262 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:15.100944 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:15.120101 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:15.123822 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Usage tracker for resource:security_group_rule and tenant:1357a99c386544928f00bd66b4f5a21b is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:15.127399 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:15.134028 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:15.225634 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:15.255726 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Sync routers for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:10:15.266172 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:10:15.266782 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe734b6fd0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:10:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:15.268170 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-b848a1a0-4451-4453-803e-f557a622c3d0 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:15.269774 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-b848a1a0-4451-4453-803e-f557a622c3d0 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/networks?id=95462097-1cc6-4207-9add-1b65afcf40ca HTTP/1.1" status: 200  len: 815 time: 0.2419083
Jun 01 10:10:15.285234 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-a6d4d51c-0db8-4993-a672-0f46c51ab11b tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/quotas/4f2a9e1dcd084ba7aeb9c96724aea0fe HTTP/1.1" status: 200  len: 375 time: 0.0096295
Jun 01 10:10:15.295778 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:15.300725 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-1a3e8c95-d64a-41f5-b0c6-14a4696072cf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:15.333454 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 879}  {{(pid=92565) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:10:15.348724 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d2baf22e-e911-4f2f-84b7-a8c1dc6945a3,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:15.353203 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:15.356757 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:15.358106 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.segments_db [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Added segment 7e83dd0c-3be4-4412-8849-fe1a2cad78c1 of type vlan for network 0d72cce9-43d5-4d22-920b-062d8cfd9fb7
Jun 01 10:10:15.384371 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-a0dbbd1b-a76f-47b0-bbf2-8d12aa5f2433 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=4f2a9e1dcd084ba7aeb9c96724aea0fe&fields=id HTTP/1.1" status: 200  len: 255 time: 0.0935426
Jun 01 10:10:15.388570 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:15.479193 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:10:15.493218 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:15.495608 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:15.497780 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:15.508746 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-9ad6d823-8125-44b4-89c2-ceb93073d7be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:15.578874 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-95da84bb-b7b9-4f79-ad28-61371e6a5ac1 service neutron] 10.222.0.68 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1860344
Jun 01 10:10:15.593299 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device b61f43ed-7118-4cdc-b650-27da1d3644ed up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:10:15.641856 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Pushing event updated for resources: {'Network': ['ID=0d72cce9-43d5-4d22-920b-062d8cfd9fb7,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:15.656409 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network 0d72cce9-43d5-4d22-920b-062d8cfd9fb7 details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:10:15.657075 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:15.708139 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 0.7202263
Jun 01 10:10:15.710759 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34844) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:15.730781 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] Request body: {'subnet': {'network_id': '0d72cce9-43d5-4d22-920b-062d8cfd9fb7', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-871855271-subnet', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b', 'ip_version': 4}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:15.737079 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:15.752123 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] Usage tracker for resource:subnet and tenant:1357a99c386544928f00bd66b4f5a21b is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:15.756506 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:15.766725 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:15.769429 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-ab97de96-3f99-42dc-8c0f-e53a1ef094c9 service neutron] 10.222.0.68 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1893539
Jun 01 10:10:15.845630 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] Made reservation on behalf of 1357a99c386544928f00bd66b4f5a21b for: {'subnet': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:10:15.848087 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3139364'] for subnet, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:15.875586 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:15.876261 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port b61f43ed-7118-4cdc-b650-27da1d3644ed completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:10:15.876569 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe734b6fd0>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 2, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:15.881403 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Checking router: 426524f6-17bf-45cb-b42b-2fec9e039ff0 for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:10:15.889788 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Updating router 426524f6-17bf-45cb-b42b-2fec9e039ff0 port f5cd5bf7-9718-4375-b561-e61f796ff6b8 binding host dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:10:15.889930 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port b61f43ed-7118-4cdc-b650-27da1d3644ed triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:15.889930 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:15.946398 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:16.018222 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:16.037438 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port b61f43ed-7118-4cdc-b650-27da1d3644ed, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=b61f43ed-7118-4cdc-b650-27da1d3644ed,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:10:16.090527 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-53c0a86a-d624-4b3a-908a-e4185c4d5061 req-52832b14-7f4a-4474-87ee-c957b1b55c98 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 210 time: 0.0551734
Jun 01 10:10:16.104224 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:16.110067 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:16.196568 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=b61f43ed-7118-4cdc-b650-27da1d3644ed,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:16.200943 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:16.384181 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Notify callbacks [] for port, precommit_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:16.403121 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.provisioning_blocks [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Transition to ACTIVE for port object f5cd5bf7-9718-4375-b561-e61f796ff6b8 will not be triggered until provisioned by entity L2. {{(pid=92568) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:10:16.472898 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:16.478027 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-68c1fac1-3db5-4562-bdd9-96a0277000f1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:16.507416 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2233128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3139378'] for subnet, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:16.512306 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a134a940-b7a9-4938-b2b2-916da5a67b35 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:16.588377 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] Pushing event updated for resources: {'Subnet': ['ID=600836e1-e1aa-4a90-94df-2b55cd865f86,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:16.591557 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:16.594617 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] Checking segment: {'id': '7e83dd0c-3be4-4412-8849-fe1a2cad78c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '0d72cce9-43d5-4d22-920b-062d8cfd9fb7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92565) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:10:16.594617 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] Network hostable DHCP agents. Network: 0d72cce9-43d5-4d22-920b-062d8cfd9fb7, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92565) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:10:16.654158 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa05a936-3bcd-4155-95f6-c9ab8e378020 None None] Pushing event updated for resources: {'Port': ['ID=f5cd5bf7-9718-4375-b561-e61f796ff6b8,revision_number=3']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:16.662812 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa05a936-3bcd-4155-95f6-c9ab8e378020 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:16.663387 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa05a936-3bcd-4155-95f6-c9ab8e378020 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:16.663593 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa05a936-3bcd-4155-95f6-c9ab8e378020 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:16.663911 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa05a936-3bcd-4155-95f6-c9ab8e378020 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:16.664228 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa05a936-3bcd-4155-95f6-c9ab8e378020 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:16.664722 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa05a936-3bcd-4155-95f6-c9ab8e378020 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:16.665212 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa05a936-3bcd-4155-95f6-c9ab8e378020 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:16.665839 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa05a936-3bcd-4155-95f6-c9ab8e378020 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:16.666345 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa05a936-3bcd-4155-95f6-c9ab8e378020 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:16.666819 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa05a936-3bcd-4155-95f6-c9ab8e378020 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:16.667328 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa05a936-3bcd-4155-95f6-c9ab8e378020 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:16.667815 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa05a936-3bcd-4155-95f6-c9ab8e378020 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:10:16.673022 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-fa05a936-3bcd-4155-95f6-c9ab8e378020 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.195s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:16.691953 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] Network 0d72cce9-43d5-4d22-920b-062d8cfd9fb7 is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92565) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:10:16.728321 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Attempting to bind port f5cd5bf7-9718-4375-b561-e61f796ff6b8 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:10:16.728699 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Attempting to bind port f5cd5bf7-9718-4375-b561-e61f796ff6b8 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:10:16.729093 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Attempting to bind port f5cd5bf7-9718-4375-b561-e61f796ff6b8 on network 83aff072-8820-4a36-b8f3-036a7011aace {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:10:16.735815 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 10, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:10:16.737069 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Checking segment: {'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92568) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:10:16.737069 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:16.737069 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Bound using segment: {'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:10:16.737517 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Bound port: f5cd5bf7-9718-4375-b561-e61f796ff6b8, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'}}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:10:16.737890 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:16.775668 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, 0d72cce9-43d5-4d22-920b-062d8cfd9fb7) {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:10:16.784809 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c15f99a7-7bcb-4c8f-ab43-67bcf6a2ba17 None None] Network 0d72cce9-43d5-4d22-920b-062d8cfd9fb7 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:10:16.788741 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:16.789346 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:16.832367 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] For port f5cd5bf7-9718-4375-b561-e61f796ff6b8, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92568) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:10:16.835522 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] For port f5cd5bf7-9718-4375-b561-e61f796ff6b8, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=f5cd5bf7-9718-4375-b561-e61f796ff6b8,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92568) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:10:16.923480 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:16.923709 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 1.2089880
Jun 01 10:10:16.923709 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34860) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:16.927435 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:16.929037 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-871855271-router', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:16.937034 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:16.941109 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Usage tracker for resource:router and tenant:1357a99c386544928f00bd66b4f5a21b is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:16.943991 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:16.949840 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:17.033497 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:10:17.034105 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe734b6fd0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:10:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:17.042244 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-405701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15802'] for router, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:17.043333 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-407493', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-403482', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-465655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-15793'] for router, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:17.063666 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ec86312-457d-532c-ad41-c4edfccc592e-0d72cce9-43d5-4d22-920b-062d8cfd9fb7', 'network_id': '0d72cce9-43d5-4d22-920b-062d8cfd9fb7', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b', 'fixed_ips': [{'subnet_id': '600836e1-e1aa-4a90-94df-2b55cd865f86'}]}} from dv-cinder-787262-4-iscsi. {{(pid=92567) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 10:10:17.064742 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:17.069043 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:17.096914 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa05a936-3bcd-4155-95f6-c9ab8e378020 None None] Pushing event updated for resources: {'Port': ['ID=f5cd5bf7-9718-4375-b561-e61f796ff6b8,revision_number=4']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:17.101609 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-fa05a936-3bcd-4155-95f6-c9ab8e378020 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:17.254824 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:10:17.265360 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.db_base_plugin_common [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Allocated IP 172.20.0.2 (0d72cce9-43d5-4d22-920b-062d8cfd9fb7/600836e1-e1aa-4a90-94df-2b55cd865f86/640cb80a-8969-4c0e-b9d6-f6e2acf57530) {{(pid=92567) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:10:17.294279 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0ef15a1a-3256-4d8f-80eb-285fd0e85ab7 req-a85f04ea-ab9a-4cf0-9f25-d5ff06440be9 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 210 time: 0.0487576
Jun 01 10:10:17.459336 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-403519', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-405751', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-15815'] for router, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:17.522268 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Notify callbacks [] for port, precommit_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:17.532396 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Transition to ACTIVE for port object 640cb80a-8969-4c0e-b9d6-f6e2acf57530 will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:10:17.540432 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device b61f43ed-7118-4cdc-b650-27da1d3644ed up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:10:17.617988 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Transition to ACTIVE for port object 640cb80a-8969-4c0e-b9d6-f6e2acf57530 will not be triggered until provisioned by entity DHCP. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:10:17.625861 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe734b6fd0>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:17.630713 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3126cf13-3778-43e8-b714-dff70f4eeeb3 None None] The sync data for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi is: [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:10:17.642780 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port b61f43ed-7118-4cdc-b650-27da1d3644ed triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:17.643184 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:17.696751 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:17.714988 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:17.808006 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Network 0d72cce9-43d5-4d22-920b-062d8cfd9fb7 is already hosted by enough agents. {{(pid=92567) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:10:17.812221 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.base_scheduler [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Resources bound (agent type, host, resource id):  {{(pid=92567) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:10:17.821952 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Received port after_create {{(pid=92567) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:10:17.824624 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Pushing event updated for resources: {'Port': ['ID=640cb80a-8969-4c0e-b9d6-f6e2acf57530,revision_number=1']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:17.832269 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:17.988892 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Attempting to bind port 640cb80a-8969-4c0e-b9d6-f6e2acf57530 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:10:17.989375 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Attempting to bind port 640cb80a-8969-4c0e-b9d6-f6e2acf57530 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '7e83dd0c-3be4-4412-8849-fe1a2cad78c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '0d72cce9-43d5-4d22-920b-062d8cfd9fb7'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:10:17.989752 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Attempting to bind port 640cb80a-8969-4c0e-b9d6-f6e2acf57530 on network 0d72cce9-43d5-4d22-920b-062d8cfd9fb7 {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:10:17.998025 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 10, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:10:17.998416 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Checking segment: {'id': '7e83dd0c-3be4-4412-8849-fe1a2cad78c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '0d72cce9-43d5-4d22-920b-062d8cfd9fb7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:10:17.998826 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:17.999264 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Bound using segment: {'id': '7e83dd0c-3be4-4412-8849-fe1a2cad78c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '0d72cce9-43d5-4d22-920b-062d8cfd9fb7'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:10:17.999844 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Bound port: 640cb80a-8969-4c0e-b9d6-f6e2acf57530, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7e83dd0c-3be4-4412-8849-fe1a2cad78c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '0d72cce9-43d5-4d22-920b-062d8cfd9fb7'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:10:18.000114 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:18.005533 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:18.044260 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:18.108925 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] For port 640cb80a-8969-4c0e-b9d6-f6e2acf57530, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:10:18.112836 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] For port 640cb80a-8969-4c0e-b9d6-f6e2acf57530, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=640cb80a-8969-4c0e-b9d6-f6e2acf57530,segment=NetworkSegment(7e83dd0c-3be4-4412-8849-fe1a2cad78c1),segment_id=7e83dd0c-3be4-4412-8849-fe1a2cad78c1)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:10:18.183569 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:18.196257 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:18.240750 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Allocated IP 172.27.2.111 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/850b8fad-e68b-443d-a9a6-3468150f9715) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:10:18.300103 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Pushing event updated for resources: {'Port': ['ID=640cb80a-8969-4c0e-b9d6-f6e2acf57530,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:18.308150 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:18.485682 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:18.521174 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-efe3cc71-7efd-494d-bb8b-eec07dfcfdb1 req-1d933227-6adf-430b-8877-80565ac684bd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 210 time: 0.0834942
Jun 01 10:10:18.612388 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:18.623368 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:18.628518 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-8cc7166d-0440-46a1-9dd2-c4aa9364e73d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:18.629939 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-8cc7166d-0440-46a1-9dd2-c4aa9364e73d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.30 "GET /v2.0/networks?id=95462097-1cc6-4207-9add-1b65afcf40ca HTTP/1.1" status: 200  len: 815 time: 0.3477747
Jun 01 10:10:18.646026 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-2064d620-65c4-4c22-8fce-065830d74ae8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Request body: {'port': {'device_id': 'fa7939f0-81fb-44e7-a0fd-492428e5028b', 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca', 'admin_state_up': True, 'tenant_id': '4f2a9e1dcd084ba7aeb9c96724aea0fe'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:18.666307 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:10:18.674888 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:10:18.687173 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:10:18.806984 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-2064d620-65c4-4c22-8fce-065830d74ae8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:18.818511 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-2064d620-65c4-4c22-8fce-065830d74ae8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:18.865545 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Pushing event updated for resources: {'Port': ['ID=850b8fad-e68b-443d-a9a6-3468150f9715,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:18.870219 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:18.914397 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-2064d620-65c4-4c22-8fce-065830d74ae8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Made reservation on behalf of 4f2a9e1dcd084ba7aeb9c96724aea0fe for: {'port': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:10:18.918243 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-2064d620-65c4-4c22-8fce-065830d74ae8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:19.089222 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-2064d620-65c4-4c22-8fce-065830d74ae8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Allocated IP 172.20.0.12 (95462097-1cc6-4207-9add-1b65afcf40ca/abf69321-90c0-4336-ac76-6ef3766e6a67/41cda8ce-e474-41cf-9b05-6c4a119eed48) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:10:19.323817 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-2064d620-65c4-4c22-8fce-065830d74ae8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:19.376497 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:19.419666 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3ba699e-85e8-4b5a-8ce2-f4fda0270ba2 None None] Network 0d72cce9-43d5-4d22-920b-062d8cfd9fb7 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:10:19.429328 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-2064d620-65c4-4c22-8fce-065830d74ae8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:19.437218 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:19.492571 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['6010d8c0-403f-4393-8c5c-fd9cc14aeecb'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:10:19.520523 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2064d620-65c4-4c22-8fce-065830d74ae8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Pushing event updated for resources: {'Port': ['ID=41cda8ce-e474-41cf-9b05-6c4a119eed48,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:19.533753 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-2064d620-65c4-4c22-8fce-065830d74ae8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Network 95462097-1cc6-4207-9add-1b65afcf40ca is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:10:19.536370 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-2064d620-65c4-4c22-8fce-065830d74ae8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:19.537664 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-2064d620-65c4-4c22-8fce-065830d74ae8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:10:19.551369 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-2064d620-65c4-4c22-8fce-065830d74ae8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:10:19.609658 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-ad607007-a658-4222-b8ec-a6f16dddc8fb None None] Provisioning for port 640cb80a-8969-4c0e-b9d6-f6e2acf57530 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:10:19.631921 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-2064d620-65c4-4c22-8fce-065830d74ae8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:19.632540 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-2064d620-65c4-4c22-8fce-065830d74ae8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:19.695138 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 640cb80a-8969-4c0e-b9d6-f6e2acf57530 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:10:19.740027 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-2064d620-65c4-4c22-8fce-065830d74ae8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.0978961
Jun 01 10:10:19.755205 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Request body: {'port': {'device_id': 'fa7939f0-81fb-44e7-a0fd-492428e5028b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:19.823696 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-405708', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-403580'] for router, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:19.896969 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-432ff3b6-224f-4eb7-8d8c-7d6bdc8a15fa req-75dda0ab-3943-4038-9fb9-64974f521b7a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:19.897573 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-432ff3b6-224f-4eb7-8d8c-7d6bdc8a15fa req-75dda0ab-3943-4038-9fb9-64974f521b7a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Synchronizing usage tracker for tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:10:19.899967 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:19.965973 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 640cb80a-8969-4c0e-b9d6-f6e2acf57530 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:10:19.973769 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 640cb80a-8969-4c0e-b9d6-f6e2acf57530 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:19.976046 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:20.030887 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-432ff3b6-224f-4eb7-8d8c-7d6bdc8a15fa req-75dda0ab-3943-4038-9fb9-64974f521b7a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Unset dirty status for tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:10:20.032075 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-432ff3b6-224f-4eb7-8d8c-7d6bdc8a15fa req-75dda0ab-3943-4038-9fb9-64974f521b7a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 932 time: 0.3345244
Jun 01 10:10:20.160700 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Router 00920640-a6b6-40f1-9c3d-5d67417288d3 is scheduled to L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c with binding_index 1 {{(pid=92565) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 10:10:20.166096 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:20.204178 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 640cb80a-8969-4c0e-b9d6-f6e2acf57530, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=640cb80a-8969-4c0e-b9d6-f6e2acf57530,segment=NetworkSegment(7e83dd0c-3be4-4412-8849-fe1a2cad78c1),segment_id=7e83dd0c-3be4-4412-8849-fe1a2cad78c1)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:10:20.229985 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-432ff3b6-224f-4eb7-8d8c-7d6bdc8a15fa req-752b4e46-ba16-4805-86ef-a92abdfb4f4f tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0861554
Jun 01 10:10:20.268367 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-cab4ead8-67a4-4209-a46f-1cc6bef0700b None None] Provisioning complete for port 640cb80a-8969-4c0e-b9d6-f6e2acf57530 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:20.268739 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cab4ead8-67a4-4209-a46f-1cc6bef0700b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:20.347675 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:10:20.359194 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Sync routers for ids ['00920640-a6b6-40f1-9c3d-5d67417288d3'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:10:20.363086 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:20.364403 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device f5cd5bf7-9718-4375-b561-e61f796ff6b8 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:10:20.395608 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:20.417243 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 41cda8ce-e474-41cf-9b05-6c4a119eed48 {{(pid=92566) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:10:20.425365 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:20.441718 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Transition to ACTIVE for port object 41cda8ce-e474-41cf-9b05-6c4a119eed48 will not be triggered until provisioned by entity L2. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:10:20.444379 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Notify callbacks [] for router, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:20.448989 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] 10.222.0.68 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 3.5209036
Jun 01 10:10:20.448989 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34882) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:20.468853 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Routers {'00920640-a6b6-40f1-9c3d-5d67417288d3'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:10:20.469477 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72832af0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:10:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['00920640-a6b6-40f1-9c3d-5d67417288d3'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:20.530385 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:20.535435 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f1960752-eebb-49be-a422-303a95820699 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:20.616063 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=640cb80a-8969-4c0e-b9d6-f6e2acf57530,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:20.676619 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.281s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:20.712152 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Pushing event updated for resources: {'Port': ['ID=41cda8ce-e474-41cf-9b05-6c4a119eed48,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:20.718792 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:20.728877 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Set router 00920640-a6b6-40f1-9c3d-5d67417288d3 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:10:20.788327 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Attempting to bind port 41cda8ce-e474-41cf-9b05-6c4a119eed48 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:10:20.788785 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Attempting to bind port 41cda8ce-e474-41cf-9b05-6c4a119eed48 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': 'f512f187-5724-4ff7-afd5-c422b0bd8ba7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca'}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:10:20.789115 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Attempting to bind port 41cda8ce-e474-41cf-9b05-6c4a119eed48 on network 95462097-1cc6-4207-9add-1b65afcf40ca {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:10:20.794672 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Port 41cda8ce-e474-41cf-9b05-6c4a119eed48 on network 95462097-1cc6-4207-9add-1b65afcf40ca not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:10:20.795014 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Attempting to bind port 41cda8ce-e474-41cf-9b05-6c4a119eed48 on network 95462097-1cc6-4207-9add-1b65afcf40ca {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:10:20.800512 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 9, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:10:20.800846 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Checking segment: {'id': 'f512f187-5724-4ff7-afd5-c422b0bd8ba7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:10:20.801306 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Bound using segment: {'id': 'f512f187-5724-4ff7-afd5-c422b0bd8ba7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca'} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:10:20.801740 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Bound port: 41cda8ce-e474-41cf-9b05-6c4a119eed48, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f512f187-5724-4ff7-afd5-c422b0bd8ba7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca'}}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:10:20.802084 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:20.829252 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port f5cd5bf7-9718-4375-b561-e61f796ff6b8 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:10:20.854121 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port f5cd5bf7-9718-4375-b561-e61f796ff6b8 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:20.854557 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:20.907018 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] For port 41cda8ce-e474-41cf-9b05-6c4a119eed48, host hv-cinder-78726, cleared binding levels {{(pid=92566) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:10:20.910281 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] For port 41cda8ce-e474-41cf-9b05-6c4a119eed48, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=41cda8ce-e474-41cf-9b05-6c4a119eed48,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92566) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:10:20.982669 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:20.990954 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:21.065511 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Pushing event updated for resources: {'Port': ['ID=41cda8ce-e474-41cf-9b05-6c4a119eed48,revision_number=3']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:21.070114 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:21.075451 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:21.076073 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:21.077561 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] 10.222.0.30 "PUT /v2.0/ports/41cda8ce-e474-41cf-9b05-6c4a119eed48 HTTP/1.1" status: 200  len: 1094 time: 1.3272414
Jun 01 10:10:21.078021 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fa7939f0-81fb-44e7-a0fd-492428e5028b', 'tag': '41cda8ce-e474-41cf-9b05-6c4a119eed48'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:10:21.081572 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-869e29fb-8a4e-4165-bfb4-f7d3fc760e44" -d '{"events": [{"name": "network-changed", "server_uuid": "fa7939f0-81fb-44e7-a0fd-492428e5028b", "tag": "41cda8ce-e474-41cf-9b05-6c4a119eed48"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:10:21.100466 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:21.135323 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:10:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fedcd8bb-d498-4e1f-87ba-2af6234e6f53 x-openstack-request-id: req-fedcd8bb-d498-4e1f-87ba-2af6234e6f53 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:10:21.135802 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fa7939f0-81fb-44e7-a0fd-492428e5028b", "tag": "41cda8ce-e474-41cf-9b05-6c4a119eed48", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:10:21.136126 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-fedcd8bb-d498-4e1f-87ba-2af6234e6f53 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:10:21.136583 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fa7939f0-81fb-44e7-a0fd-492428e5028b', 'tag': '41cda8ce-e474-41cf-9b05-6c4a119eed48', 'status': 'completed', 'code': 200}
Jun 01 10:10:21.149115 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port f5cd5bf7-9718-4375-b561-e61f796ff6b8, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=f5cd5bf7-9718-4375-b561-e61f796ff6b8,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:10:21.165074 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72832af0>, [{'id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'name': 'tempest-TestVolumeBootPattern-871855271-router', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111'}], 'enable_snat': True}, 'gw_port_id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:17Z', 'updated_at': '2021-06-01T10:10:19Z', 'revision_number': 3, 'project_id': '1357a99c386544928f00bd66b4f5a21b', 'gw_port': {'id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:f1:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 409, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:18Z', 'updated_at': '2021-06-01T10:10:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:21.172054 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Checking router: 00920640-a6b6-40f1-9c3d-5d67417288d3 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:10:21.172464 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Updating router 00920640-a6b6-40f1-9c3d-5d67417288d3 port 850b8fad-e68b-443d-a9a6-3468150f9715 binding host dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:10:21.249197 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:21.249907 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-869e29fb-8a4e-4165-bfb4-f7d3fc760e44 req-52a5637c-d22a-46b3-b29a-21a666c9216d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:21.251521 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-869e29fb-8a4e-4165-bfb4-f7d3fc760e44 req-52a5637c-d22a-46b3-b29a-21a666c9216d service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=4f2a9e1dcd084ba7aeb9c96724aea0fe&device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 1097 time: 0.0877302
Jun 01 10:10:21.276420 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:21.284451 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:21.295593 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:21.440012 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=f5cd5bf7-9718-4375-b561-e61f796ff6b8,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:21.446100 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:21.481050 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-869e29fb-8a4e-4165-bfb4-f7d3fc760e44 req-3eb6648f-e185-4c41-b45f-2b3a792edef3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:21.482762 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-869e29fb-8a4e-4165-bfb4-f7d3fc760e44 req-3eb6648f-e185-4c41-b45f-2b3a792edef3 service neutron] 10.222.0.30 "GET /v2.0/networks?tenant_id=4f2a9e1dcd084ba7aeb9c96724aea0fe&shared=False HTTP/1.1" status: 200  len: 916 time: 0.2212820
Jun 01 10:10:21.494829 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa326a8-57bf-46d2-a0cb-a37f779bc8b0 req-c616b729-529b-4c83-9b70-c018bb1d32c5 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:21.503828 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7fa326a8-57bf-46d2-a0cb-a37f779bc8b0 req-c616b729-529b-4c83-9b70-c018bb1d32c5 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 944 time: 0.1420093
Jun 01 10:10:21.563888 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Allocated IP 172.20.0.1 (0d72cce9-43d5-4d22-920b-062d8cfd9fb7/600836e1-e1aa-4a90-94df-2b55cd865f86/f30fad44-c9e2-4619-8a3a-64a7a505f0a4) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:10:21.582571 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 640cb80a-8969-4c0e-b9d6-f6e2acf57530 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:10:21.635497 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7fa326a8-57bf-46d2-a0cb-a37f779bc8b0 req-03ceef94-c8c5-4cce-8d7d-c9a6d7e527f8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1313910
Jun 01 10:10:21.695910 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-869e29fb-8a4e-4165-bfb4-f7d3fc760e44 req-8a39cef2-8190-45b2-af45-56e2029550a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:21.697526 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-869e29fb-8a4e-4165-bfb4-f7d3fc760e44 req-8a39cef2-8190-45b2-af45-56e2029550a5 service neutron] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1918762
Jun 01 10:10:21.741889 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 640cb80a-8969-4c0e-b9d6-f6e2acf57530 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:21.742274 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:21.752917 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:21.771271 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.provisioning_blocks [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Transition to ACTIVE for port object f30fad44-c9e2-4619-8a3a-64a7a505f0a4 will not be triggered until provisioned by entity DHCP. {{(pid=92565) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:10:21.804661 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Notify callbacks [] for port, precommit_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:21.820686 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Transition to ACTIVE for port object 850b8fad-e68b-443d-a9a6-3468150f9715 will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:10:21.836643 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-b567a0ce-302b-4e63-a7c2-97707da680a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:21.838131 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-b567a0ce-302b-4e63-a7c2-97707da680a3 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=4f2a9e1dcd084ba7aeb9c96724aea0fe&device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 1097 time: 0.0862966
Jun 01 10:10:21.884006 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device f5cd5bf7-9718-4375-b561-e61f796ff6b8 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:10:21.891925 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:21.895713 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:21.914526 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:21.921654 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-2b72eee2-2257-486b-8800-dbf45ad8a601 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=41cda8ce-e474-41cf-9b05-6c4a119eed48 HTTP/1.1" status: 200  len: 217 time: 0.0680385
Jun 01 10:10:21.960582 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:21.977157 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Network 0d72cce9-43d5-4d22-920b-062d8cfd9fb7 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:10:21.980032 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:10:21.984756 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:10:22.000161 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-898420fc-f56b-4fc6-a32d-3e30abf95e4e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:22.001880 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-898420fc-f56b-4fc6-a32d-3e30abf95e4e service neutron] 10.222.0.30 "GET /v2.0/subnets?id=abf69321-90c0-4336-ac76-6ef3766e6a67 HTTP/1.1" status: 200  len: 855 time: 0.0685234
Jun 01 10:10:22.023022 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Pushing event updated for resources: {'Port': ['ID=f30fad44-c9e2-4619-8a3a-64a7a505f0a4,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:22.031848 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:22.056139 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-401677'] for router_interface, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:22.057082 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Attempting to bind port 850b8fad-e68b-443d-a9a6-3468150f9715 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:10:22.057444 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Attempting to bind port 850b8fad-e68b-443d-a9a6-3468150f9715 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:10:22.057809 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Attempting to bind port 850b8fad-e68b-443d-a9a6-3468150f9715 on network a961b732-0873-4e86-af5a-7e84ae1a2549 {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:10:22.060993 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-f48444e2-3e99-4873-b74e-65cf275cc754 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=95462097-1cc6-4207-9add-1b65afcf40ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0509562
Jun 01 10:10:22.065411 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1a5ece1-8767-49f2-b112-fd84e232645b None None] Pushing event updated for resources: {'Port': ['ID=850b8fad-e68b-443d-a9a6-3468150f9715,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:22.069084 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-c1a5ece1-8767-49f2-b112-fd84e232645b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:22.072683 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 10, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:10:22.073063 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Checking segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:10:22.073469 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:22.073862 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Bound using segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:10:22.074337 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Bound port: 850b8fad-e68b-443d-a9a6-3468150f9715, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:10:22.074747 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:22.132755 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port f5cd5bf7-9718-4375-b561-e61f796ff6b8 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:22.132978 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:22.200485 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] For port 850b8fad-e68b-443d-a9a6-3468150f9715, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:10:22.205022 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] For port 850b8fad-e68b-443d-a9a6-3468150f9715, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=850b8fad-e68b-443d-a9a6-3468150f9715,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:10:22.233589 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-946eecb2-eb39-4dca-87ed-a95cec96f834 service neutron] 10.222.0.30 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1510849
Jun 01 10:10:22.285640 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:22.343781 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:22.374919 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:22.453763 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Routers {'00920640-a6b6-40f1-9c3d-5d67417288d3'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:10:22.454514 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72832af0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:10:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['00920640-a6b6-40f1-9c3d-5d67417288d3'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:22.483436 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cafc0cff-d48b-4b42-91c0-18454b6d9e49 req-b3bb16e2-01a8-49f6-b499-83ed153193c9 service neutron] 10.222.0.30 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2428224
Jun 01 10:10:22.537664 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1a5ece1-8767-49f2-b112-fd84e232645b None None] Pushing event updated for resources: {'Port': ['ID=850b8fad-e68b-443d-a9a6-3468150f9715,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:22.542929 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-c1a5ece1-8767-49f2-b112-fd84e232645b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:22.570721 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:22.603589 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-3662515b-fa5d-4eda-a534-273127527139 None None] Provisioning for port f30fad44-c9e2-4619-8a3a-64a7a505f0a4 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:10:22.626368 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-3662515b-fa5d-4eda-a534-273127527139 None None] Provisioning complete for port f30fad44-c9e2-4619-8a3a-64a7a505f0a4 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:22.626823 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-3662515b-fa5d-4eda-a534-273127527139 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:22.695883 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2295697'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:22.696833 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-3662515b-fa5d-4eda-a534-273127527139 None None] Port f30fad44-c9e2-4619-8a3a-64a7a505f0a4 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:10:22.699369 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] Set router 00920640-a6b6-40f1-9c3d-5d67417288d3 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:10:22.741835 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-96029ef7-7793-49de-bb90-16861279f72f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:22.815395 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7873030', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-401824'] for router_interface, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:22.824388 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Pushing event updated for resources: {'Port': ['ID=f30fad44-c9e2-4619-8a3a-64a7a505f0a4,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:22.828467 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:22.837663 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50757dc2-b7fe-454b-ba22-55a86568256a req-b273068a-019e-40a7-9494-88582e274c27 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:22.843721 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-50757dc2-b7fe-454b-ba22-55a86568256a req-b273068a-019e-40a7-9494-88582e274c27 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 944 time: 0.1064568
Jun 01 10:10:22.888408 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-50757dc2-b7fe-454b-ba22-55a86568256a req-2d1ddc73-822d-4dcd-971b-faf0154a3089 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420885
Jun 01 10:10:23.040330 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72832af0>, [{'id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'name': 'tempest-TestVolumeBootPattern-871855271-router', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111'}], 'enable_snat': True}, 'gw_port_id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:17Z', 'updated_at': '2021-06-01T10:10:22Z', 'revision_number': 4, 'project_id': '1357a99c386544928f00bd66b4f5a21b', 'gw_port': {'id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:f1:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 409, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:18Z', 'updated_at': '2021-06-01T10:10:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'f30fad44-c9e2-4619-8a3a-64a7a505f0a4', 'name': '', 'network_id': '0d72cce9-43d5-4d22-920b-062d8cfd9fb7', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b', 'mac_address': 'fa:16:3e:ae:6e:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'device_owner': 'network:router_interface', 'standard_attr_id': 411, 'fixed_ips': [{'subnet_id': '600836e1-e1aa-4a90-94df-2b55cd865f86', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:21Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 1, 'project_id': '1357a99c386544928f00bd66b4f5a21b', 'subnets': [{'id': '600836e1-e1aa-4a90-94df-2b55cd865f86', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:23.045219 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fbad3cd-3320-4ccf-b5f8-ef9fda37aa25 None None] The sync data for ids ['00920640-a6b6-40f1-9c3d-5d67417288d3'] in dv-cinder-787262-4-iscsi is: [{'id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'name': 'tempest-TestVolumeBootPattern-871855271-router', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111'}], 'enable_snat': True}, 'gw_port_id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:17Z', 'updated_at': '2021-06-01T10:10:22Z', 'revision_number': 4, 'project_id': '1357a99c386544928f00bd66b4f5a21b', 'gw_port': {'id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:f1:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 409, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:18Z', 'updated_at': '2021-06-01T10:10:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'f30fad44-c9e2-4619-8a3a-64a7a505f0a4', 'name': '', 'network_id': '0d72cce9-43d5-4d22-920b-062d8cfd9fb7', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b', 'mac_address': 'fa:16:3e:ae:6e:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'device_owner': 'network:router_interface', 'standard_attr_id': 411, 'fixed_ips': [{'subnet_id': '600836e1-e1aa-4a90-94df-2b55cd865f86', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:21Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 1, 'project_id': '1357a99c386544928f00bd66b4f5a21b', 'subnets': [{'id': '600836e1-e1aa-4a90-94df-2b55cd865f86', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:10:23.065518 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Network 0d72cce9-43d5-4d22-920b-062d8cfd9fb7 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:10:23.066636 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:10:23.295076 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Router 00920640-a6b6-40f1-9c3d-5d67417288d3 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:10:23.333629 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-fad2a8a4-e242-4ec5-a503-19887c947074 None None] Provisioning complete for port f30fad44-c9e2-4619-8a3a-64a7a505f0a4 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:23.334010 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-fad2a8a4-e242-4ec5-a503-19887c947074 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:23.395084 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-fad2a8a4-e242-4ec5-a503-19887c947074 None None] Port f30fad44-c9e2-4619-8a3a-64a7a505f0a4 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:10:23.487701 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:10:23.498214 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] 10.222.0.68 "PUT /v2.0/routers/00920640-a6b6-40f1-9c3d-5d67417288d3/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.0486910
Jun 01 10:10:24.077842 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-267799de-ca90-4564-9a38-bba78b166697 req-c18e576c-05b6-4863-ac4b-e052aad20714 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:24.079307 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-267799de-ca90-4564-9a38-bba78b166697 req-c18e576c-05b6-4863-ac4b-e052aad20714 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 944 time: 0.0786448
Jun 01 10:10:24.142463 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-267799de-ca90-4564-9a38-bba78b166697 req-23c28afe-333a-426a-a048-33e0e01bc0b9 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0573850
Jun 01 10:10:24.151546 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34914) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:24.159055 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-77947ddd-73de-4d9f-8af4-c274ee4478f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-881588482', 'description': 'tempest-secgroup-smoke-881588482 description', 'project_id': 'cfa9132b1ba044548228b96f6c2755eb'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:24.165187 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-77947ddd-73de-4d9f-8af4-c274ee4478f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:24.169512 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-77947ddd-73de-4d9f-8af4-c274ee4478f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Usage tracker for resource:security_group and tenant:cfa9132b1ba044548228b96f6c2755eb is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:24.175578 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-77947ddd-73de-4d9f-8af4-c274ee4478f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:24.181493 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-77947ddd-73de-4d9f-8af4-c274ee4478f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:24.268512 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-77947ddd-73de-4d9f-8af4-c274ee4478f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:24.288709 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-77947ddd-73de-4d9f-8af4-c274ee4478f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:24.292533 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-77947ddd-73de-4d9f-8af4-c274ee4478f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Usage tracker for resource:security_group_rule and tenant:cfa9132b1ba044548228b96f6c2755eb is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:24.295499 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-77947ddd-73de-4d9f-8af4-c274ee4478f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:24.302124 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-77947ddd-73de-4d9f-8af4-c274ee4478f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:24.369347 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-77947ddd-73de-4d9f-8af4-c274ee4478f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:24.428256 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-77947ddd-73de-4d9f-8af4-c274ee4478f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:24.431800 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:24.472288 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77947ddd-73de-4d9f-8af4-c274ee4478f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event updated for resources: {'SecurityGroup': ['ID=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:24.474927 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-77947ddd-73de-4d9f-8af4-c274ee4478f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:24.535848 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-77947ddd-73de-4d9f-8af4-c274ee4478f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:24.537188 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-77947ddd-73de-4d9f-8af4-c274ee4478f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 0.3831406
Jun 01 10:10:24.540244 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34918) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:24.546071 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-c5e10e4c-19eb-43f0-9d2e-e0da7cfc6e4c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Request body: {'security_group_rule': {'security_group_id': '53e3d69f-76f1-4e9a-808e-b6a7c88db3f4', 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:24.552269 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-c5e10e4c-19eb-43f0-9d2e-e0da7cfc6e4c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:24.556454 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-c5e10e4c-19eb-43f0-9d2e-e0da7cfc6e4c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Usage tracker for resource:security_group_rule and tenant:cfa9132b1ba044548228b96f6c2755eb is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:24.559953 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-c5e10e4c-19eb-43f0-9d2e-e0da7cfc6e4c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:24.565853 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-c5e10e4c-19eb-43f0-9d2e-e0da7cfc6e4c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:24.639423 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c5e10e4c-19eb-43f0-9d2e-e0da7cfc6e4c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:24.706224 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c5e10e4c-19eb-43f0-9d2e-e0da7cfc6e4c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:24.805799 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c5e10e4c-19eb-43f0-9d2e-e0da7cfc6e4c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:24.808150 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:24.831375 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5e10e4c-19eb-43f0-9d2e-e0da7cfc6e4c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d270395e-3d91-4057-a593-7c5bdc902415,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:24.834820 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c5e10e4c-19eb-43f0-9d2e-e0da7cfc6e4c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:24.895934 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c5e10e4c-19eb-43f0-9d2e-e0da7cfc6e4c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:24.897078 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-c5e10e4c-19eb-43f0-9d2e-e0da7cfc6e4c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3553739
Jun 01 10:10:24.899785 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 34922) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:24.904918 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-1d594021-1f18-4357-8df8-91dc04b53f26 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Request body: {'security_group_rule': {'security_group_id': '53e3d69f-76f1-4e9a-808e-b6a7c88db3f4', 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:24.910867 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-1d594021-1f18-4357-8df8-91dc04b53f26 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:24.914893 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-1d594021-1f18-4357-8df8-91dc04b53f26 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Usage tracker for resource:security_group_rule and tenant:cfa9132b1ba044548228b96f6c2755eb is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:24.918193 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-1d594021-1f18-4357-8df8-91dc04b53f26 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:24.924944 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-1d594021-1f18-4357-8df8-91dc04b53f26 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:25.004790 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1d594021-1f18-4357-8df8-91dc04b53f26 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:25.068868 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1d594021-1f18-4357-8df8-91dc04b53f26 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:25.155109 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1d594021-1f18-4357-8df8-91dc04b53f26 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:25.157047 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:25.180014 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d594021-1f18-4357-8df8-91dc04b53f26 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6c3f2d97-49e3-4aae-a3ce-2887f0d73047,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:25.183080 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-1d594021-1f18-4357-8df8-91dc04b53f26 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:25.251683 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1d594021-1f18-4357-8df8-91dc04b53f26 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:25.253022 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-1d594021-1f18-4357-8df8-91dc04b53f26 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.3522847
Jun 01 10:10:25.255702 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 34930) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:25.261047 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-4b1caee9-37fd-4945-9acd-b01277188b27 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Request body: {'security_group_rule': {'security_group_id': '53e3d69f-76f1-4e9a-808e-b6a7c88db3f4', 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:25.266997 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-4b1caee9-37fd-4945-9acd-b01277188b27 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:25.272252 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-4b1caee9-37fd-4945-9acd-b01277188b27 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Usage tracker for resource:security_group_rule and tenant:cfa9132b1ba044548228b96f6c2755eb is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:25.305211 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-4b1caee9-37fd-4945-9acd-b01277188b27 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:25.319152 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-4b1caee9-37fd-4945-9acd-b01277188b27 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:25.361261 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beff05f0-03d8-416d-b80c-410fc5bd13cc req-57da919a-0503-4524-92a2-a17685233913 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:25.362715 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-beff05f0-03d8-416d-b80c-410fc5bd13cc req-57da919a-0503-4524-92a2-a17685233913 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 944 time: 0.0933497
Jun 01 10:10:25.409293 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-beff05f0-03d8-416d-b80c-410fc5bd13cc req-1da5b752-907c-4f9e-b9e7-108eeeb9bc32 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406406
Jun 01 10:10:25.431133 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4b1caee9-37fd-4945-9acd-b01277188b27 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:25.492724 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4b1caee9-37fd-4945-9acd-b01277188b27 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:25.559378 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 850b8fad-e68b-443d-a9a6-3468150f9715 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:10:25.568198 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4b1caee9-37fd-4945-9acd-b01277188b27 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:25.570473 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:25.594993 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b1caee9-37fd-4945-9acd-b01277188b27 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b209e50e-5443-4703-8385-c393de819ba3,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:25.600584 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-4b1caee9-37fd-4945-9acd-b01277188b27 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:25.691465 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4b1caee9-37fd-4945-9acd-b01277188b27 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:25.691465 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-4b1caee9-37fd-4945-9acd-b01277188b27 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4301169
Jun 01 10:10:25.691465 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 34936) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:25.694893 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-6ef79149-d15a-4115-9859-147226e6d933 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Request body: {'security_group_rule': {'security_group_id': '53e3d69f-76f1-4e9a-808e-b6a7c88db3f4', 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:25.701752 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6ef79149-d15a-4115-9859-147226e6d933 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:25.702930 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 850b8fad-e68b-443d-a9a6-3468150f9715 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:10:25.711405 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6ef79149-d15a-4115-9859-147226e6d933 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Usage tracker for resource:security_group_rule and tenant:cfa9132b1ba044548228b96f6c2755eb is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:25.711682 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 850b8fad-e68b-443d-a9a6-3468150f9715 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:25.711767 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6ef79149-d15a-4115-9859-147226e6d933 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:25.711855 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:25.718039 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6ef79149-d15a-4115-9859-147226e6d933 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:25.720510 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-082665f9-9786-4297-8709-c287c6486968 None None] Sync routers for ids ['00920640-a6b6-40f1-9c3d-5d67417288d3'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:10:25.731421 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-082665f9-9786-4297-8709-c287c6486968 None None] Routers {'00920640-a6b6-40f1-9c3d-5d67417288d3'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:10:25.732112 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-082665f9-9786-4297-8709-c287c6486968 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72b434c0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:10:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['00920640-a6b6-40f1-9c3d-5d67417288d3'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:25.798072 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6ef79149-d15a-4115-9859-147226e6d933 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:25.834684 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:25.853728 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 850b8fad-e68b-443d-a9a6-3468150f9715, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=850b8fad-e68b-443d-a9a6-3468150f9715,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:10:25.868954 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6ef79149-d15a-4115-9859-147226e6d933 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:25.919055 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-082665f9-9786-4297-8709-c287c6486968 None None] Set router 00920640-a6b6-40f1-9c3d-5d67417288d3 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:10:25.949200 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:25.953019 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:25.970571 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6ef79149-d15a-4115-9859-147226e6d933 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:25.972646 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-4a414974-9bab-4af8-ac6e-747a28d1befd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:25.989433 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ef79149-d15a-4115-9859-147226e6d933 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e64cf3c8-7e27-4b6f-a58e-be2886fdeead,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:26.001167 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6ef79149-d15a-4115-9859-147226e6d933 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:26.022464 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=850b8fad-e68b-443d-a9a6-3468150f9715,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:26.025651 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:26.061266 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6ef79149-d15a-4115-9859-147226e6d933 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:26.062594 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-6ef79149-d15a-4115-9859-147226e6d933 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.3720298
Jun 01 10:10:26.065224 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 34940) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:26.070772 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-30e0940e-5d97-40be-9359-a5a1e3d47ad3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Request body: {'security_group_rule': {'security_group_id': '53e3d69f-76f1-4e9a-808e-b6a7c88db3f4', 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:26.077245 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-30e0940e-5d97-40be-9359-a5a1e3d47ad3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:26.081203 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-30e0940e-5d97-40be-9359-a5a1e3d47ad3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Usage tracker for resource:security_group_rule and tenant:cfa9132b1ba044548228b96f6c2755eb is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:26.084069 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-30e0940e-5d97-40be-9359-a5a1e3d47ad3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:26.089956 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-30e0940e-5d97-40be-9359-a5a1e3d47ad3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:26.154470 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.securitygroups_db [None req-30e0940e-5d97-40be-9359-a5a1e3d47ad3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Project cfa9132b1ba044548228b96f6c2755eb added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 10:10:26.160421 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-30e0940e-5d97-40be-9359-a5a1e3d47ad3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:26.224007 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-30e0940e-5d97-40be-9359-a5a1e3d47ad3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:26.232683 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-082665f9-9786-4297-8709-c287c6486968 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72b434c0>, [{'id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'name': 'tempest-TestVolumeBootPattern-871855271-router', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111'}], 'enable_snat': True}, 'gw_port_id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:17Z', 'updated_at': '2021-06-01T10:10:22Z', 'revision_number': 4, 'project_id': '1357a99c386544928f00bd66b4f5a21b', 'gw_port': {'id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:f1:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 409, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:18Z', 'updated_at': '2021-06-01T10:10:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'f30fad44-c9e2-4619-8a3a-64a7a505f0a4', 'name': '', 'network_id': '0d72cce9-43d5-4d22-920b-062d8cfd9fb7', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b', 'mac_address': 'fa:16:3e:ae:6e:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'device_owner': 'network:router_interface', 'standard_attr_id': 411, 'fixed_ips': [{'subnet_id': '600836e1-e1aa-4a90-94df-2b55cd865f86', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:21Z', 'updated_at': '2021-06-01T10:10:22Z', 'revision_number': 2, 'project_id': '1357a99c386544928f00bd66b4f5a21b', 'subnets': [{'id': '600836e1-e1aa-4a90-94df-2b55cd865f86', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:26.236527 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-082665f9-9786-4297-8709-c287c6486968 None None] Checking router: 00920640-a6b6-40f1-9c3d-5d67417288d3 for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:10:26.236872 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-082665f9-9786-4297-8709-c287c6486968 None None] Updating router 00920640-a6b6-40f1-9c3d-5d67417288d3 port f30fad44-c9e2-4619-8a3a-64a7a505f0a4 binding host dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:10:26.288439 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-082665f9-9786-4297-8709-c287c6486968 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:26.297430 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-30e0940e-5d97-40be-9359-a5a1e3d47ad3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:26.299623 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-4b1caee9-37fd-4945-9acd-b01277188b27 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:26.322287 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30e0940e-5d97-40be-9359-a5a1e3d47ad3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ecbcf71f-01b2-415d-9ec6-89047357aad1,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:26.324708 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-30e0940e-5d97-40be-9359-a5a1e3d47ad3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:26.394653 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-30e0940e-5d97-40be-9359-a5a1e3d47ad3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:26.395983 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-30e0940e-5d97-40be-9359-a5a1e3d47ad3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.3297846
Jun 01 10:10:26.398808 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 34946) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:26.404116 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-6068265a-6da3-4123-a419-4ddd18dbbe3f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Request body: {'security_group_rule': {'security_group_id': '53e3d69f-76f1-4e9a-808e-b6a7c88db3f4', 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:26.409709 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6068265a-6da3-4123-a419-4ddd18dbbe3f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:26.413522 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6068265a-6da3-4123-a419-4ddd18dbbe3f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Usage tracker for resource:security_group_rule and tenant:cfa9132b1ba044548228b96f6c2755eb is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:26.416512 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6068265a-6da3-4123-a419-4ddd18dbbe3f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:26.422767 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6068265a-6da3-4123-a419-4ddd18dbbe3f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:26.544805 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:26.551481 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.securitygroups_db [None req-6068265a-6da3-4123-a419-4ddd18dbbe3f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Project cfa9132b1ba044548228b96f6c2755eb added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 10:10:26.563642 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6068265a-6da3-4123-a419-4ddd18dbbe3f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:26.645288 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b6aef52-e97d-4fae-b9f9-508e8b43d0c5 req-d8bcfdb9-5c7a-4fcb-afc1-4be1872fe6b7 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:26.646738 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1b6aef52-e97d-4fae-b9f9-508e8b43d0c5 req-d8bcfdb9-5c7a-4fcb-afc1-4be1872fe6b7 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 944 time: 0.1319506
Jun 01 10:10:26.662442 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-082665f9-9786-4297-8709-c287c6486968 None None] Notify callbacks [] for port, precommit_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:26.673185 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6068265a-6da3-4123-a419-4ddd18dbbe3f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:26.674513 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.provisioning_blocks [None req-082665f9-9786-4297-8709-c287c6486968 None None] Transition to ACTIVE for port object f30fad44-c9e2-4619-8a3a-64a7a505f0a4 will not be triggered until provisioned by entity L2. {{(pid=92568) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:10:26.699819 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1b6aef52-e97d-4fae-b9f9-508e8b43d0c5 req-4bdfee55-5745-46aa-87c5-7ae22fa98341 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0440457
Jun 01 10:10:26.796346 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6068265a-6da3-4123-a419-4ddd18dbbe3f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:26.798370 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6ef79149-d15a-4115-9859-147226e6d933 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:26.823021 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6068265a-6da3-4123-a419-4ddd18dbbe3f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=edc84299-2879-4016-be57-4df6f880c9e0,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:26.825358 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6068265a-6da3-4123-a419-4ddd18dbbe3f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:26.830161 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-082665f9-9786-4297-8709-c287c6486968 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:26.834455 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:26.930303 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6068265a-6da3-4123-a419-4ddd18dbbe3f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:26.932317 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-6068265a-6da3-4123-a419-4ddd18dbbe3f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.5322249
Jun 01 10:10:27.020001 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e92e7cb7-71e4-470a-8f0e-74f4461a07e7 None None] Pushing event updated for resources: {'Port': ['ID=f30fad44-c9e2-4619-8a3a-64a7a505f0a4,revision_number=3']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:27.024672 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-e92e7cb7-71e4-470a-8f0e-74f4461a07e7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:27.099679 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-082665f9-9786-4297-8709-c287c6486968 None None] Attempting to bind port f30fad44-c9e2-4619-8a3a-64a7a505f0a4 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:10:27.101809 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-082665f9-9786-4297-8709-c287c6486968 None None] Attempting to bind port f30fad44-c9e2-4619-8a3a-64a7a505f0a4 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '7e83dd0c-3be4-4412-8849-fe1a2cad78c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '0d72cce9-43d5-4d22-920b-062d8cfd9fb7'}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:10:27.102253 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-082665f9-9786-4297-8709-c287c6486968 None None] Attempting to bind port f30fad44-c9e2-4619-8a3a-64a7a505f0a4 on network 0d72cce9-43d5-4d22-920b-062d8cfd9fb7 {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:10:27.108258 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-082665f9-9786-4297-8709-c287c6486968 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 10, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:10:27.108735 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-082665f9-9786-4297-8709-c287c6486968 None None] Checking segment: {'id': '7e83dd0c-3be4-4412-8849-fe1a2cad78c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '0d72cce9-43d5-4d22-920b-062d8cfd9fb7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92568) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:10:27.108939 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e5a73359-c9e1-4006-b340-31f806fe8c2f req-6cbcb4bb-e1ad-4aaf-9811-af4eea6ca232 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0980265
Jun 01 10:10:27.109212 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-082665f9-9786-4297-8709-c287c6486968 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:27.109617 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-082665f9-9786-4297-8709-c287c6486968 None None] Bound using segment: {'id': '7e83dd0c-3be4-4412-8849-fe1a2cad78c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '0d72cce9-43d5-4d22-920b-062d8cfd9fb7'} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:10:27.110069 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-082665f9-9786-4297-8709-c287c6486968 None None] Bound port: f30fad44-c9e2-4619-8a3a-64a7a505f0a4, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7e83dd0c-3be4-4412-8849-fe1a2cad78c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '0d72cce9-43d5-4d22-920b-062d8cfd9fb7'}}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:10:27.110443 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-082665f9-9786-4297-8709-c287c6486968 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:27.228929 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-082665f9-9786-4297-8709-c287c6486968 None None] For port f30fad44-c9e2-4619-8a3a-64a7a505f0a4, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92568) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:10:27.233313 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-082665f9-9786-4297-8709-c287c6486968 None None] For port f30fad44-c9e2-4619-8a3a-64a7a505f0a4, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=f30fad44-c9e2-4619-8a3a-64a7a505f0a4,segment=NetworkSegment(7e83dd0c-3be4-4412-8849-fe1a2cad78c1),segment_id=7e83dd0c-3be4-4412-8849-fe1a2cad78c1)] {{(pid=92568) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:10:27.250017 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a73359-c9e1-4006-b340-31f806fe8c2f req-fbc1b05f-03ac-40ce-9162-d483e86000e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:27.254294 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e5a73359-c9e1-4006-b340-31f806fe8c2f req-fbc1b05f-03ac-40ce-9162-d483e86000e3 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=f4f6f875519045a39c1fdbadd53ce517&device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 1100 time: 0.1100130
Jun 01 10:10:27.302267 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-082665f9-9786-4297-8709-c287c6486968 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:27.313425 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-fa05a936-3bcd-4155-95f6-c9ab8e378020 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:27.428696 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-082665f9-9786-4297-8709-c287c6486968 None None] Routers {'00920640-a6b6-40f1-9c3d-5d67417288d3'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:10:27.429338 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-082665f9-9786-4297-8709-c287c6486968 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72b434c0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:10:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['00920640-a6b6-40f1-9c3d-5d67417288d3'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:27.485420 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a73359-c9e1-4006-b340-31f806fe8c2f req-d01d2d34-1f2d-4897-a98c-363c6776fbdb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:27.489595 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e5a73359-c9e1-4006-b340-31f806fe8c2f req-d01d2d34-1f2d-4897-a98c-363c6776fbdb service neutron] 10.222.0.30 "GET /v2.0/networks?id=be546533-cf92-483d-9e38-7d14ca9c4902 HTTP/1.1" status: 200  len: 917 time: 0.2166035
Jun 01 10:10:27.549550 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e92e7cb7-71e4-470a-8f0e-74f4461a07e7 None None] Pushing event updated for resources: {'Port': ['ID=f30fad44-c9e2-4619-8a3a-64a7a505f0a4,revision_number=4']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:27.560507 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-e92e7cb7-71e4-470a-8f0e-74f4461a07e7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:27.589694 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 850b8fad-e68b-443d-a9a6-3468150f9715 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:10:27.635238 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e5a73359-c9e1-4006-b340-31f806fe8c2f req-87d38dbd-dd22-4e15-a225-f1eb8d0b7de4 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ba4fa832-87bd-477b-bad8-2837ab09304a HTTP/1.1" status: 200  len: 1002 time: 0.1353908
Jun 01 10:10:27.687002 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-082665f9-9786-4297-8709-c287c6486968 None None] Set router 00920640-a6b6-40f1-9c3d-5d67417288d3 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:10:27.696666 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 850b8fad-e68b-443d-a9a6-3468150f9715 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:27.697054 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:27.757221 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a73359-c9e1-4006-b340-31f806fe8c2f req-8e6bd6cb-a719-4113-a787-132cf380a4b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:27.758798 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e5a73359-c9e1-4006-b340-31f806fe8c2f req-8e6bd6cb-a719-4113-a787-132cf380a4b6 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=f2fdda64-a03c-41d7-8178-daca0363bd6e HTTP/1.1" status: 200  len: 855 time: 0.1088183
Jun 01 10:10:27.945776 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91535719-7033-43b6-b7f4-5cdc3cca954b req-be5f2c57-d9f2-4442-a3bf-b508f59346b1 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:27.947410 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-91535719-7033-43b6-b7f4-5cdc3cca954b req-be5f2c57-d9f2-4442-a3bf-b508f59346b1 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 944 time: 0.1084609
Jun 01 10:10:27.957539 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a73359-c9e1-4006-b340-31f806fe8c2f req-ef8282a8-431c-4815-b98e-adadd103333b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:27.957539 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e5a73359-c9e1-4006-b340-31f806fe8c2f req-ef8282a8-431c-4815-b98e-adadd103333b service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=be546533-cf92-483d-9e38-7d14ca9c4902&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1832113
Jun 01 10:10:28.084751 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-082665f9-9786-4297-8709-c287c6486968 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72b434c0>, [{'id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'name': 'tempest-TestVolumeBootPattern-871855271-router', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111'}], 'enable_snat': True}, 'gw_port_id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:17Z', 'updated_at': '2021-06-01T10:10:22Z', 'revision_number': 4, 'project_id': '1357a99c386544928f00bd66b4f5a21b', 'gw_port': {'id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:f1:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 409, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:18Z', 'updated_at': '2021-06-01T10:10:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'f30fad44-c9e2-4619-8a3a-64a7a505f0a4', 'name': '', 'network_id': '0d72cce9-43d5-4d22-920b-062d8cfd9fb7', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b', 'mac_address': 'fa:16:3e:ae:6e:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'device_owner': 'network:router_interface', 'standard_attr_id': 411, 'fixed_ips': [{'subnet_id': '600836e1-e1aa-4a90-94df-2b55cd865f86', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:21Z', 'updated_at': '2021-06-01T10:10:27Z', 'revision_number': 4, 'project_id': '1357a99c386544928f00bd66b4f5a21b', 'subnets': [{'id': '600836e1-e1aa-4a90-94df-2b55cd865f86', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:28.088605 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-91535719-7033-43b6-b7f4-5cdc3cca954b req-430f0722-2fb4-4329-98b1-50a3810c4649 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1289315
Jun 01 10:10:28.092962 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-082665f9-9786-4297-8709-c287c6486968 None None] The sync data for ids ['00920640-a6b6-40f1-9c3d-5d67417288d3'] in dv-cinder-787262-4-iscsi is: [{'id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'name': 'tempest-TestVolumeBootPattern-871855271-router', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111'}], 'enable_snat': True}, 'gw_port_id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:17Z', 'updated_at': '2021-06-01T10:10:22Z', 'revision_number': 4, 'project_id': '1357a99c386544928f00bd66b4f5a21b', 'gw_port': {'id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:f1:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 409, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:18Z', 'updated_at': '2021-06-01T10:10:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'f30fad44-c9e2-4619-8a3a-64a7a505f0a4', 'name': '', 'network_id': '0d72cce9-43d5-4d22-920b-062d8cfd9fb7', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b', 'mac_address': 'fa:16:3e:ae:6e:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'device_owner': 'network:router_interface', 'standard_attr_id': 411, 'fixed_ips': [{'subnet_id': '600836e1-e1aa-4a90-94df-2b55cd865f86', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:21Z', 'updated_at': '2021-06-01T10:10:27Z', 'revision_number': 4, 'project_id': '1357a99c386544928f00bd66b4f5a21b', 'subnets': [{'id': '600836e1-e1aa-4a90-94df-2b55cd865f86', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:10:28.148934 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e5a73359-c9e1-4006-b340-31f806fe8c2f req-d71ab611-84b0-481d-898b-76637ffbc911 service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1738644
Jun 01 10:10:28.377334 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e5a73359-c9e1-4006-b340-31f806fe8c2f req-1b5fd630-d489-44f8-b92c-391f6e76fd0c service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2189445
Jun 01 10:10:28.421005 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 41cda8ce-e474-41cf-9b05-6c4a119eed48 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:10:28.604455 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 41cda8ce-e474-41cf-9b05-6c4a119eed48, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=41cda8ce-e474-41cf-9b05-6c4a119eed48,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:10:28.622686 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': '41cda8ce-e474-41cf-9b05-6c4a119eed48', 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca', 'port_id': '41cda8ce-e474-41cf-9b05-6c4a119eed48', 'mac_address': 'fa:16:3e:bb:3b:91', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 897, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'abf69321-90c0-4336-ac76-6ef3766e6a67', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:10:28.679882 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:28.697441 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 41cda8ce-e474-41cf-9b05-6c4a119eed48 {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:10:28.713334 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 41cda8ce-e474-41cf-9b05-6c4a119eed48, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=41cda8ce-e474-41cf-9b05-6c4a119eed48,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:10:28.776042 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:28.778319 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:28.848178 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=41cda8ce-e474-41cf-9b05-6c4a119eed48,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:28.851175 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:29.276599 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8cd60b0-71b8-4daf-94d6-e68fdd437c69 req-f127a8b1-f7a6-405e-adeb-81cbaef8676f tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:29.278716 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e8cd60b0-71b8-4daf-94d6-e68fdd437c69 req-f127a8b1-f7a6-405e-adeb-81cbaef8676f tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 945 time: 0.0804265
Jun 01 10:10:29.322462 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e8cd60b0-71b8-4daf-94d6-e68fdd437c69 req-4dcdb303-00d4-4393-b6b7-e42ddf1a0e11 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0381267
Jun 01 10:10:29.553502 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device f30fad44-c9e2-4619-8a3a-64a7a505f0a4 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:10:29.691137 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port f30fad44-c9e2-4619-8a3a-64a7a505f0a4 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:10:29.696109 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port f30fad44-c9e2-4619-8a3a-64a7a505f0a4 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:29.696510 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:29.812555 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:29.844327 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port f30fad44-c9e2-4619-8a3a-64a7a505f0a4, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=f30fad44-c9e2-4619-8a3a-64a7a505f0a4,segment=NetworkSegment(7e83dd0c-3be4-4412-8849-fe1a2cad78c1),segment_id=7e83dd0c-3be4-4412-8849-fe1a2cad78c1)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:10:29.929734 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:29.931588 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:29.996010 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=f30fad44-c9e2-4619-8a3a-64a7a505f0a4,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:29.999533 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:30.517461 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a56b263-cd8b-4de5-9c0c-c25b76791c82 req-d7272b7d-313d-4798-98aa-c4b662f63488 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:30.519027 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7a56b263-cd8b-4de5-9c0c-c25b76791c82 req-d7272b7d-313d-4798-98aa-c4b662f63488 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 945 time: 0.0871611
Jun 01 10:10:30.563563 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7a56b263-cd8b-4de5-9c0c-c25b76791c82 req-70d83f19-45f9-4ed3-817f-34289aff2330 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387530
Jun 01 10:10:31.534744 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device f30fad44-c9e2-4619-8a3a-64a7a505f0a4 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:10:31.606359 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port f30fad44-c9e2-4619-8a3a-64a7a505f0a4 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:31.606734 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:31.778269 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98afbe41-cda6-477d-9517-aa7a8f72e7a9 req-fff1e6ed-14f8-47b3-b57e-f503f30b78d0 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:31.779869 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-98afbe41-cda6-477d-9517-aa7a8f72e7a9 req-fff1e6ed-14f8-47b3-b57e-f503f30b78d0 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 945 time: 0.0967469
Jun 01 10:10:31.828910 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-98afbe41-cda6-477d-9517-aa7a8f72e7a9 req-b9bb2ca8-ff56-42bd-8d40-aefe56915520 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429311
Jun 01 10:10:31.894090 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['41cda8ce-e474-41cf-9b05-6c4a119eed48'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:10:33.016997 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26b9dc78-c4c1-46db-a538-eed088474999 req-e4a13ead-4cf4-4d34-b41f-0ca0ef50355b tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:33.018448 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-26b9dc78-c4c1-46db-a538-eed088474999 req-e4a13ead-4cf4-4d34-b41f-0ca0ef50355b tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 945 time: 0.0815716
Jun 01 10:10:33.065196 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-26b9dc78-c4c1-46db-a538-eed088474999 req-952af0cf-b524-4e3d-be5d-e2ad76765b6f tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410838
Jun 01 10:10:33.421193 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cacdb09f-e92e-4091-a020-9c5ed6bd119e req-e6882826-a9a9-4e22-a391-ff521ed9b2b6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:33.422640 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cacdb09f-e92e-4091-a020-9c5ed6bd119e req-e6882826-a9a9-4e22-a391-ff521ed9b2b6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 947 time: 0.0835426
Jun 01 10:10:33.467578 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cacdb09f-e92e-4091-a020-9c5ed6bd119e req-68b355ae-00a3-4351-91ce-1a3d5e7d3f4f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0392280
Jun 01 10:10:34.254837 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16d52353-d844-43a5-b180-36c24d605884 req-1b9ad334-d7ea-4df8-861b-238a9937dcc4 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:34.269679 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-16d52353-d844-43a5-b180-36c24d605884 req-1b9ad334-d7ea-4df8-861b-238a9937dcc4 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 945 time: 0.0806375
Jun 01 10:10:34.288744 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 41cda8ce-e474-41cf-9b05-6c4a119eed48 up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:10:34.302506 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-16d52353-d844-43a5-b180-36c24d605884 req-2fe4656d-9516-46ce-bd61-d08a8b78c301 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405815
Jun 01 10:10:34.428697 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port 41cda8ce-e474-41cf-9b05-6c4a119eed48 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:10:34.433687 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port 41cda8ce-e474-41cf-9b05-6c4a119eed48 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:34.434068 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:34.551754 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:34.581443 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fa7939f0-81fb-44e7-a0fd-492428e5028b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '41cda8ce-e474-41cf-9b05-6c4a119eed48'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:10:34.583697 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-29bf5e41-be99-449e-8832-4cc766013732" -d '{"events": [{"server_uuid": "fa7939f0-81fb-44e7-a0fd-492428e5028b", "name": "network-vif-plugged", "status": "completed", "tag": "41cda8ce-e474-41cf-9b05-6c4a119eed48"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:10:34.591528 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 41cda8ce-e474-41cf-9b05-6c4a119eed48, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=41cda8ce-e474-41cf-9b05-6c4a119eed48,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:10:34.626153 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:10:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-22a884c5-2de4-45ba-853f-2c0b812038b6 x-openstack-request-id: req-22a884c5-2de4-45ba-853f-2c0b812038b6 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:10:34.626454 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fa7939f0-81fb-44e7-a0fd-492428e5028b", "name": "network-vif-plugged", "status": "completed", "tag": "41cda8ce-e474-41cf-9b05-6c4a119eed48", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:10:34.626717 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-22a884c5-2de4-45ba-853f-2c0b812038b6 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:10:34.627146 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fa7939f0-81fb-44e7-a0fd-492428e5028b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '41cda8ce-e474-41cf-9b05-6c4a119eed48', 'code': 200}
Jun 01 10:10:34.666803 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a6d6b79-182e-4804-9e20-1395e403c736 req-7e7c0bf5-c37d-493a-a407-6f5ce4591920 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:34.668275 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9a6d6b79-182e-4804-9e20-1395e403c736 req-7e7c0bf5-c37d-493a-a407-6f5ce4591920 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 947 time: 0.0888073
Jun 01 10:10:34.684255 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:34.686243 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:34.714980 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9a6d6b79-182e-4804-9e20-1395e403c736 req-a1e98177-8388-478a-b551-7b608dafeede tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0410461
Jun 01 10:10:34.753850 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=41cda8ce-e474-41cf-9b05-6c4a119eed48,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:34.756945 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:35.472063 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:10:35.502275 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bf0779c-814a-4726-bb72-c67d764013f8 req-788e89bc-8153-47aa-a4e5-4735d45f9f97 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:35.503780 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2bf0779c-814a-4726-bb72-c67d764013f8 req-788e89bc-8153-47aa-a4e5-4735d45f9f97 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 946 time: 0.0827167
Jun 01 10:10:35.552985 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2bf0779c-814a-4726-bb72-c67d764013f8 req-103bdb5a-d917-4f60-b580-01d21917a225 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436046
Jun 01 10:10:35.909850 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee62200d-c6b5-4367-b591-6090dc28cfff req-7247794a-617d-4252-a9d2-181b0a0b02e4 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:35.911323 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ee62200d-c6b5-4367-b591-6090dc28cfff req-7247794a-617d-4252-a9d2-181b0a0b02e4 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 947 time: 0.0856559
Jun 01 10:10:35.957821 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ee62200d-c6b5-4367-b591-6090dc28cfff req-6764aa40-7e21-4bab-b877-7f0b676a9874 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0407767
Jun 01 10:10:36.801261 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bb142c6-9b96-4527-9133-9a2862931ac5 req-7b1caa08-3458-4ae9-bd89-6b6d464cc3b4 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:36.802734 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2bb142c6-9b96-4527-9133-9a2862931ac5 req-7b1caa08-3458-4ae9-bd89-6b6d464cc3b4 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 946 time: 0.1435237
Jun 01 10:10:36.805469 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af01aa5f-2df5-4b75-813a-835462d364b0 req-7e4f7d12-2088-4093-901e-02db55b3583b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:36.806782 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-af01aa5f-2df5-4b75-813a-835462d364b0 req-7e4f7d12-2088-4093-901e-02db55b3583b service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 1099 time: 0.1149995
Jun 01 10:10:36.877383 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2bb142c6-9b96-4527-9133-9a2862931ac5 req-dc78dfcd-1f4b-4d90-9320-f81ccbd35791 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0687730
Jun 01 10:10:36.880806 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-af01aa5f-2df5-4b75-813a-835462d364b0 req-b920ea8d-47d0-4e4c-b099-adde44ef43a8 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0593727
Jun 01 10:10:37.162075 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cf05074-901d-4c16-b616-822975d48b39 req-16666f4c-7013-47e6-a46f-610932c72b5e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:37.162075 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1cf05074-901d-4c16-b616-822975d48b39 req-16666f4c-7013-47e6-a46f-610932c72b5e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.30 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 947 time: 0.1450961
Jun 01 10:10:37.227722 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb14b494-f65c-499d-8dbd-c73cbc3c93db req-49acfc8d-e5f3-4f2c-b59e-884e7d075c93 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:37.229227 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cb14b494-f65c-499d-8dbd-c73cbc3c93db req-49acfc8d-e5f3-4f2c-b59e-884e7d075c93 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 947 time: 0.1572022
Jun 01 10:10:37.333082 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cb14b494-f65c-499d-8dbd-c73cbc3c93db req-8dfcf498-9176-4ed7-b92f-4a608777141d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=325ff63e-d052-497f-a7db-055e207d9f35&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0971560
Jun 01 10:10:37.366434 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-1cf05074-901d-4c16-b616-822975d48b39 req-339e9192-e00e-4306-88dc-297fe8b75992 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Deleting port ba4fa832-87bd-477b-bad8-2837ab09304a {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:10:37.366776 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-1cf05074-901d-4c16-b616-822975d48b39 req-339e9192-e00e-4306-88dc-297fe8b75992 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:37.516894 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-1cf05074-901d-4c16-b616-822975d48b39 req-339e9192-e00e-4306-88dc-297fe8b75992 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] For port ba4fa832-87bd-477b-bad8-2837ab09304a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=ba4fa832-87bd-477b-bad8-2837ab09304a,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:10:37.517290 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-1cf05074-901d-4c16-b616-822975d48b39 req-339e9192-e00e-4306-88dc-297fe8b75992 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:37.922580 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-1cf05074-901d-4c16-b616-822975d48b39 req-339e9192-e00e-4306-88dc-297fe8b75992 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:37.923208 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-1cf05074-901d-4c16-b616-822975d48b39 req-339e9192-e00e-4306-88dc-297fe8b75992 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:37.923326 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.l3_db [req-1cf05074-901d-4c16-b616-822975d48b39 req-339e9192-e00e-4306-88dc-297fe8b75992 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Floating IP 59c9c8d8-4740-4068-b480-d0c42e3b7761 disassociated. External IP: 172.27.2.156, port: ba4fa832-87bd-477b-bad8-2837ab09304a.
Jun 01 10:10:37.923632 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-1cf05074-901d-4c16-b616-822975d48b39 req-339e9192-e00e-4306-88dc-297fe8b75992 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Calling delete_port for ba4fa832-87bd-477b-bad8-2837ab09304a owned by compute:nova {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:10:38.123558 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cb22373-258d-4f9d-99f7-1db60c9830fd req-035f25ed-bd7b-410e-b4a1-49f432f3c9a9 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:38.125015 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4cb22373-258d-4f9d-99f7-1db60c9830fd req-035f25ed-bd7b-410e-b4a1-49f432f3c9a9 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 946 time: 0.1095033
Jun 01 10:10:38.170084 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4cb22373-258d-4f9d-99f7-1db60c9830fd req-a2969e24-e7ae-4111-9ee5-8625475ce161 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392981
Jun 01 10:10:38.177325 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-1cf05074-901d-4c16-b616-822975d48b39 req-339e9192-e00e-4306-88dc-297fe8b75992 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:38.184324 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:38.234995 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-339e9192-e00e-4306-88dc-297fe8b75992 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event deleted for resources: {'Port': ['ID=ba4fa832-87bd-477b-bad8-2837ab09304a,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:38.239153 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-339e9192-e00e-4306-88dc-297fe8b75992 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:38.434187 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [req-1cf05074-901d-4c16-b616-822975d48b39 req-339e9192-e00e-4306-88dc-297fe8b75992 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Router d65374d4-451b-4890-a2f5-a4bcac5a9a38 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92566) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:10:38.566489 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6a070c60-662a-4335-b7e4-a47a404a9a98 req-09173777-2cc4-4ba8-9651-fe4c1fd43ff9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 210 time: 0.0663469
Jun 01 10:10:38.663017 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-1cf05074-901d-4c16-b616-822975d48b39 req-339e9192-e00e-4306-88dc-297fe8b75992 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:10:38.674556 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-867f4b6a-13fb-4e59-8bfe-25d03e6048d9 None None] Sync routers for ids ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:10:38.683970 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-867f4b6a-13fb-4e59-8bfe-25d03e6048d9 None None] Routers {'d65374d4-451b-4890-a2f5-a4bcac5a9a38'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:10:38.684598 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-867f4b6a-13fb-4e59-8bfe-25d03e6048d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe734ef7f0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:10:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:38.755886 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-1cf05074-901d-4c16-b616-822975d48b39 req-339e9192-e00e-4306-88dc-297fe8b75992 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] No DVR routers for this DVR port ba4fa832-87bd-477b-bad8-2837ab09304a on host hv-cinder-78726 {{(pid=92566) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:10:38.758531 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-1cf05074-901d-4c16-b616-822975d48b39 req-339e9192-e00e-4306-88dc-297fe8b75992 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:38.761420 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '77032f84-7f38-4e7e-b0fd-accc20754797', 'name': 'network-vif-deleted', 'tag': 'ba4fa832-87bd-477b-bad8-2837ab09304a'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:10:38.763741 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-14fb49c8-abdd-4e51-bb44-007c08a30810" -d '{"events": [{"server_uuid": "77032f84-7f38-4e7e-b0fd-accc20754797", "name": "network-vif-deleted", "tag": "ba4fa832-87bd-477b-bad8-2837ab09304a"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:10:38.813662 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:10:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e1d73d45-4c4c-44d3-8c77-68b9a89b63e7 x-openstack-request-id: req-e1d73d45-4c4c-44d3-8c77-68b9a89b63e7 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:10:38.813972 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "77032f84-7f38-4e7e-b0fd-accc20754797", "name": "network-vif-deleted", "tag": "ba4fa832-87bd-477b-bad8-2837ab09304a", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:10:38.814246 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-e1d73d45-4c4c-44d3-8c77-68b9a89b63e7 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:10:38.814663 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '77032f84-7f38-4e7e-b0fd-accc20754797', 'name': 'network-vif-deleted', 'tag': 'ba4fa832-87bd-477b-bad8-2837ab09304a', 'status': 'completed', 'code': 200}
Jun 01 10:10:38.859081 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1cf05074-901d-4c16-b616-822975d48b39 req-339e9192-e00e-4306-88dc-297fe8b75992 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.30 "DELETE /v2.0/ports/ba4fa832-87bd-477b-bad8-2837ab09304a HTTP/1.1" status: 204  len: 173 time: 1.6934431
Jun 01 10:10:38.874860 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-867f4b6a-13fb-4e59-8bfe-25d03e6048d9 None None] Set router d65374d4-451b-4890-a2f5-a4bcac5a9a38 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:10:39.226014 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-867f4b6a-13fb-4e59-8bfe-25d03e6048d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe734ef7f0>, [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:18Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '476d2473-d40f-4cca-8a85-8b1ea30a5281', 'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'mac_address': 'fa:16:3e:87:a6:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:15Z', 'updated_at': '2021-06-01T10:06:36Z', 'revision_number': 5, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'subnets': [{'id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:39.230112 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-867f4b6a-13fb-4e59-8bfe-25d03e6048d9 None None] Checking router: d65374d4-451b-4890-a2f5-a4bcac5a9a38 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:10:39.241400 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-867f4b6a-13fb-4e59-8bfe-25d03e6048d9 None None] Routers {'d65374d4-451b-4890-a2f5-a4bcac5a9a38'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:10:39.242459 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-867f4b6a-13fb-4e59-8bfe-25d03e6048d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe734ef7f0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:10:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:39.406264 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1611f5ac-bc45-4a58-8445-7993e95a28f2 req-c1a09b19-744e-41bb-aa13-e6dd559a8524 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:39.407948 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1611f5ac-bc45-4a58-8445-7993e95a28f2 req-c1a09b19-744e-41bb-aa13-e6dd559a8524 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 946 time: 0.1024022
Jun 01 10:10:39.444463 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-867f4b6a-13fb-4e59-8bfe-25d03e6048d9 None None] Set router d65374d4-451b-4890-a2f5-a4bcac5a9a38 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:10:39.465404 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1611f5ac-bc45-4a58-8445-7993e95a28f2 req-535b2902-7ba3-4f9b-8177-ae881dc89ccc tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0509379
Jun 01 10:10:39.761476 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-6cd4aa8b-1d57-4581-a959-057b067cadd6 req-459b2e62-b007-47ba-9d7b-9d636e15d173 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Synchronizing usage tracker for tenant:f4f6f875519045a39c1fdbadd53ce517 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:10:39.843910 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-867f4b6a-13fb-4e59-8bfe-25d03e6048d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe734ef7f0>, [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:18Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '476d2473-d40f-4cca-8a85-8b1ea30a5281', 'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'mac_address': 'fa:16:3e:87:a6:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:15Z', 'updated_at': '2021-06-01T10:06:36Z', 'revision_number': 5, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'subnets': [{'id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:10:39.848754 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-867f4b6a-13fb-4e59-8bfe-25d03e6048d9 None None] The sync data for ids ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'] in dv-cinder-787262-4-iscsi is: [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:18Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '476d2473-d40f-4cca-8a85-8b1ea30a5281', 'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'mac_address': 'fa:16:3e:87:a6:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:15Z', 'updated_at': '2021-06-01T10:06:36Z', 'revision_number': 5, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'subnets': [{'id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:10:39.856197 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-6cd4aa8b-1d57-4581-a959-057b067cadd6 req-459b2e62-b007-47ba-9d7b-9d636e15d173 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Unset dirty status for tenant:f4f6f875519045a39c1fdbadd53ce517 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:10:39.861535 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6cd4aa8b-1d57-4581-a959-057b067cadd6 req-459b2e62-b007-47ba-9d7b-9d636e15d173 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=77032f84-7f38-4e7e-b0fd-accc20754797 HTTP/1.1" status: 200  len: 210 time: 0.1455131
Jun 01 10:10:40.132215 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4c2448e-cf66-4fa4-800c-8afebd0280ce None None] New status for floating IP 59c9c8d8-4740-4068-b480-d0c42e3b7761: DOWN {{(pid=92568) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:10:40.493726 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-25842a82-22b6-4a2c-8d20-63306396e220 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:41.083141 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 35152) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:41.152503 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b56321ab-6771-4a46-8097-3f2a1a937f52 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:41.180480 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b56321ab-6771-4a46-8097-3f2a1a937f52 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:41.388432 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b56321ab-6771-4a46-8097-3f2a1a937f52 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:41.394254 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a28886e0-cb52-4134-bd81-892280494e54 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:41.409074 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b56321ab-6771-4a46-8097-3f2a1a937f52 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=325ff63e-d052-497f-a7db-055e207d9f35,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:41.412396 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b56321ab-6771-4a46-8097-3f2a1a937f52 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:41.502115 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b56321ab-6771-4a46-8097-3f2a1a937f52 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:41.503307 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-b56321ab-6771-4a46-8097-3f2a1a937f52 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "DELETE /v2.0/security-groups/325ff63e-d052-497f-a7db-055e207d9f35 HTTP/1.1" status: 204  len: 168 time: 0.4220924
Jun 01 10:10:41.507142 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 35160) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:41.526122 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.api.v2.resource [None req-6a1ed824-a84b-433e-b3f0-73c25bba8295 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] show failed (client error): The resource could not be found.
Jun 01 10:10:41.527176 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-6a1ed824-a84b-433e-b3f0-73c25bba8295 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups/325ff63e-d052-497f-a7db-055e207d9f35 HTTP/1.1" status: 404  len: 347 time: 0.0202532
Jun 01 10:10:41.530061 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 35164) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:41.589591 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device ba4fa832-87bd-477b-bad8-2837ab09304a no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:10:41.633193 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: ba4fa832-87bd-477b-bad8-2837ab09304a {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:10:41.633547 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device ba4fa832-87bd-477b-bad8-2837ab09304a not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:10:41.767086 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-ddcb04b1-3ba6-4146-ad19-43e6bf406390 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Deleting port 007db53e-7ad3-414b-9328-2fcfc4b2ba7b {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:10:41.767431 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ddcb04b1-3ba6-4146-ad19-43e6bf406390 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:41.968180 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ddcb04b1-3ba6-4146-ad19-43e6bf406390 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:41.968609 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ddcb04b1-3ba6-4146-ad19-43e6bf406390 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:42.096342 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-ddcb04b1-3ba6-4146-ad19-43e6bf406390 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Calling delete_port for 007db53e-7ad3-414b-9328-2fcfc4b2ba7b owned by network:floatingip {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:10:42.411423 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ddcb04b1-3ba6-4146-ad19-43e6bf406390 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:42.415536 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:42.463102 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddcb04b1-3ba6-4146-ad19-43e6bf406390 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event deleted for resources: {'Port': ['ID=007db53e-7ad3-414b-9328-2fcfc4b2ba7b,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:42.466605 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-ddcb04b1-3ba6-4146-ad19-43e6bf406390 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:42.558367 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ddcb04b1-3ba6-4146-ad19-43e6bf406390 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for floatingip, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:42.628837 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ddcb04b1-3ba6-4146-ad19-43e6bf406390 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:42.634357 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-ddcb04b1-3ba6-4146-ad19-43e6bf406390 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "DELETE /v2.0/floatingips/59c9c8d8-4740-4068-b480-d0c42e3b7761 HTTP/1.1" status: 204  len: 168 time: 1.0991943
Jun 01 10:10:42.931275 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-1d7df933-a4af-45b2-9611-83c599a348e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:43.031058 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-0c046264-ff61-4374-bf75-db0492d7a8ca tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:43.032409 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-0c046264-ff61-4374-bf75-db0492d7a8ca tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/networks?id=95462097-1cc6-4207-9add-1b65afcf40ca HTTP/1.1" status: 200  len: 815 time: 0.1553328
Jun 01 10:10:43.054216 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-14e4130e-89d6-44ef-8cc6-36b5344e1812 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/quotas/4f2a9e1dcd084ba7aeb9c96724aea0fe HTTP/1.1" status: 200  len: 375 time: 0.0153694
Jun 01 10:10:43.143716 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-0f8f4e49-cbfa-413c-b444-0c8773d8fae2 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=4f2a9e1dcd084ba7aeb9c96724aea0fe&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0839462
Jun 01 10:10:43.178653 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 35196) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:43.188357 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-daa0481e-0fd0-462e-be6d-a9e9130c6abc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Request body: {'security_group': {'name': 'tempest-securitygroup--375229311', 'description': 'tempest-description--1903770590'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:43.237909 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-daa0481e-0fd0-462e-be6d-a9e9130c6abc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:43.252588 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-daa0481e-0fd0-462e-be6d-a9e9130c6abc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Usage tracker for resource:security_group and tenant:f4f6f875519045a39c1fdbadd53ce517 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:43.261835 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-daa0481e-0fd0-462e-be6d-a9e9130c6abc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:43.268764 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:43.270445 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-daa0481e-0fd0-462e-be6d-a9e9130c6abc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:43.313640 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-907f5881-e4a9-40ac-be78-7b1b551a040c service neutron] 10.222.0.68 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1632946
Jun 01 10:10:43.408168 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-daa0481e-0fd0-462e-be6d-a9e9130c6abc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:43.445400 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-daa0481e-0fd0-462e-be6d-a9e9130c6abc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:43.460177 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-daa0481e-0fd0-462e-be6d-a9e9130c6abc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Usage tracker for resource:security_group_rule and tenant:f4f6f875519045a39c1fdbadd53ce517 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:43.465425 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-daa0481e-0fd0-462e-be6d-a9e9130c6abc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:43.476038 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-daa0481e-0fd0-462e-be6d-a9e9130c6abc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:43.482999 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-9de062dd-a975-4e08-81e0-885ec74b3665 service neutron] 10.222.0.68 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1634610
Jun 01 10:10:43.566502 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-daa0481e-0fd0-462e-be6d-a9e9130c6abc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:43.667340 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-daa0481e-0fd0-462e-be6d-a9e9130c6abc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:43.672730 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b40bd02c-0681-41fc-a8c7-a4713188597a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:43.723506 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daa0481e-0fd0-462e-be6d-a9e9130c6abc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:43.727920 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-daa0481e-0fd0-462e-be6d-a9e9130c6abc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:43.811350 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cc73a502-132b-41ae-991a-1dbc3b96a43e req-64f480d2-79b5-4c67-be70-f5e6eee41561 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 210 time: 0.0547106
Jun 01 10:10:43.818580 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-daa0481e-0fd0-462e-be6d-a9e9130c6abc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:43.820547 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-daa0481e-0fd0-462e-be6d-a9e9130c6abc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.6405702
Jun 01 10:10:43.823446 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 35210) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:43.830972 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-6ec0fa4a-ddfe-416e-887c-a6cb1a32469a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Request body: {'security_group_rule': {'security_group_id': '0a1ee7c6-132b-4e91-9d58-cd0c0ebba815', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:43.844677 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-6ec0fa4a-ddfe-416e-887c-a6cb1a32469a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:43.850564 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-6ec0fa4a-ddfe-416e-887c-a6cb1a32469a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Usage tracker for resource:security_group_rule and tenant:f4f6f875519045a39c1fdbadd53ce517 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:43.854587 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-6ec0fa4a-ddfe-416e-887c-a6cb1a32469a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:43.861694 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-6ec0fa4a-ddfe-416e-887c-a6cb1a32469a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:43.977791 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6ec0fa4a-ddfe-416e-887c-a6cb1a32469a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:44.039543 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6ec0fa4a-ddfe-416e-887c-a6cb1a32469a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:44.045845 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:44.131445 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6ec0fa4a-ddfe-416e-887c-a6cb1a32469a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:44.133798 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:44.151731 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ec0fa4a-ddfe-416e-887c-a6cb1a32469a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e4d84679-c35a-4661-8762-7b0356cf3333,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:44.169426 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-6ec0fa4a-ddfe-416e-887c-a6cb1a32469a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:44.234650 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6ec0fa4a-ddfe-416e-887c-a6cb1a32469a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:44.235944 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-6ec0fa4a-ddfe-416e-887c-a6cb1a32469a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.4113667
Jun 01 10:10:44.238760 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 35220) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:44.243818 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-9ade90de-a1ec-4eb2-8a14-0eb97163909a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Request body: {'security_group_rule': {'security_group_id': '0a1ee7c6-132b-4e91-9d58-cd0c0ebba815', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:44.250297 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-9ade90de-a1ec-4eb2-8a14-0eb97163909a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:44.254144 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-9ade90de-a1ec-4eb2-8a14-0eb97163909a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Usage tracker for resource:security_group_rule and tenant:f4f6f875519045a39c1fdbadd53ce517 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:44.257038 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-9ade90de-a1ec-4eb2-8a14-0eb97163909a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:44.263481 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-9ade90de-a1ec-4eb2-8a14-0eb97163909a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:44.321644 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-231d7f57-7f5f-4714-87c8-8181f0d1b35a req-66493a69-b14c-40d1-9dec-50a918ceb8ac tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:44.321644 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-231d7f57-7f5f-4714-87c8-8181f0d1b35a req-66493a69-b14c-40d1-9dec-50a918ceb8ac tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 945 time: 0.0844243
Jun 01 10:10:44.366067 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-231d7f57-7f5f-4714-87c8-8181f0d1b35a req-1942c415-23c7-47b0-af0e-3282719e0bf3 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407822
Jun 01 10:10:44.394404 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ade90de-a1ec-4eb2-8a14-0eb97163909a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:44.459953 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ade90de-a1ec-4eb2-8a14-0eb97163909a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:44.531307 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ade90de-a1ec-4eb2-8a14-0eb97163909a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:44.533505 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c1cc3990-e98d-48aa-a467-52a9e3cc1c9e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:44.555820 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ade90de-a1ec-4eb2-8a14-0eb97163909a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d8ed2b8c-e644-46ab-91f1-4949b840f62f,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:44.558196 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-9ade90de-a1ec-4eb2-8a14-0eb97163909a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:44.609818 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ade90de-a1ec-4eb2-8a14-0eb97163909a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:44.611095 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-9ade90de-a1ec-4eb2-8a14-0eb97163909a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.3713188
Jun 01 10:10:44.614417 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 35226) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:10:44.619767 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Request body: {'floatingip': {'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:44.625550 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:44.629351 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Usage tracker for resource:floatingip and tenant:f4f6f875519045a39c1fdbadd53ce517 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:44.632403 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:44.638078 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:44.725858 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for floatingip, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:44.866771 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:44.989374 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f54c673f-5f41-4ad5-af58-d24ee93f5784 req-f3e698a6-4b47-4216-b014-70e07db156bb tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 210 time: 0.0553210
Jun 01 10:10:45.007375 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Allocated IP 172.27.2.136 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/bc58c3ee-72d2-4eb7-b6c5-cfd054f1ee53) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:10:45.157846 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:45.267371 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:45.271250 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:45.340581 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:10:45.343498 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:10:45.346880 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:10:45.376732 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event updated for resources: {'Port': ['ID=bc58c3ee-72d2-4eb7-b6c5-cfd054f1ee53,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:45.383666 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:45.429923 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:45.553605 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0df04560-949b-42b9-b43e-512a40efc131 req-3f2dd198-cb76-4692-8e42-813a884c2841 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:45.555196 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0df04560-949b-42b9-b43e-512a40efc131 req-3f2dd198-cb76-4692-8e42-813a884c2841 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 945 time: 0.0810227
Jun 01 10:10:45.570858 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:45.603477 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0df04560-949b-42b9-b43e-512a40efc131 req-eb680fcf-78b8-4ecb-b969-f702d61a4582 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417769
Jun 01 10:10:45.754060 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:45.879220 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:46.006009 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2295697'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:46.009956 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:46.128346 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event updated for resources: {'Port': ['ID=bc58c3ee-72d2-4eb7-b6c5-cfd054f1ee53,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:46.132282 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:46.142060 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:46.200657 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4f1734b0-8bb2-4260-b315-6531dfa16538 req-0548c4e7-f5dc-4009-a025-6a2e5974b09b tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 210 time: 0.0591273
Jun 01 10:10:46.251422 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a47f24a-a1dc-4d08-afce-ae3bdd8e44ec req-abdfdcb4-c75f-42bb-82e8-efbe5e4f4761 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:46.253002 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4a47f24a-a1dc-4d08-afce-ae3bdd8e44ec req-abdfdcb4-c75f-42bb-82e8-efbe5e4f4761 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.30 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 945 time: 0.0948992
Jun 01 10:10:46.300891 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:46.302285 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 1.6868107
Jun 01 10:10:46.337790 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-de255b1a-1a3d-4338-aa38-3216595e8361 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:46.339487 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-de255b1a-1a3d-4338-aa38-3216595e8361 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.30 "GET /v2.0/networks?id=95462097-1cc6-4207-9add-1b65afcf40ca HTTP/1.1" status: 200  len: 815 time: 0.2925348
Jun 01 10:10:46.353711 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-0e3d75f1-0f63-426e-9ed7-35cc40f26c79 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Request body: {'port': {'device_id': '1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa', 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca', 'admin_state_up': True, 'tenant_id': '4f2a9e1dcd084ba7aeb9c96724aea0fe'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:46.421507 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [req-4a47f24a-a1dc-4d08-afce-ae3bdd8e44ec req-6775543f-5876-41c2-8be5-3857f518be26 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Deleting port 28a39b92-2011-41b3-9cde-cee66d2ea507 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:10:46.422136 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-4a47f24a-a1dc-4d08-afce-ae3bdd8e44ec req-6775543f-5876-41c2-8be5-3857f518be26 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:46.496572 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-0e3d75f1-0f63-426e-9ed7-35cc40f26c79 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:46.508706 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-0e3d75f1-0f63-426e-9ed7-35cc40f26c79 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:46.565693 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-50965745-d131-468b-9b47-e6036d309a30 req-6cc9f078-5f6c-4f8e-a07c-24cda90ee886 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Synchronizing usage tracker for tenant:f4f6f875519045a39c1fdbadd53ce517 on resource:security_group {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:10:46.580489 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-4a47f24a-a1dc-4d08-afce-ae3bdd8e44ec req-6775543f-5876-41c2-8be5-3857f518be26 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] For port 28a39b92-2011-41b3-9cde-cee66d2ea507, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=28a39b92-2011-41b3-9cde-cee66d2ea507,segment=NetworkSegment(f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793),segment_id=f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:10:46.583782 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-4a47f24a-a1dc-4d08-afce-ae3bdd8e44ec req-6775543f-5876-41c2-8be5-3857f518be26 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:46.598158 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-0e3d75f1-0f63-426e-9ed7-35cc40f26c79 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Made reservation on behalf of 4f2a9e1dcd084ba7aeb9c96724aea0fe for: {'port': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:10:46.601876 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-0e3d75f1-0f63-426e-9ed7-35cc40f26c79 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:46.660999 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-50965745-d131-468b-9b47-e6036d309a30 req-6cc9f078-5f6c-4f8e-a07c-24cda90ee886 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Unset dirty status for tenant:f4f6f875519045a39c1fdbadd53ce517 on resource:security_group {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:10:46.662169 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-50965745-d131-468b-9b47-e6036d309a30 req-6cc9f078-5f6c-4f8e-a07c-24cda90ee886 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?name=tempest-securitygroup--375229311&fields=id&tenant_id=f4f6f875519045a39c1fdbadd53ce517 HTTP/1.1" status: 200  len: 267 time: 0.1362107
Jun 01 10:10:46.716231 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [req-4a47f24a-a1dc-4d08-afce-ae3bdd8e44ec req-6775543f-5876-41c2-8be5-3857f518be26 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Calling delete_port for 28a39b92-2011-41b3-9cde-cee66d2ea507 owned by compute:nova {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:10:46.907046 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-4a47f24a-a1dc-4d08-afce-ae3bdd8e44ec req-6775543f-5876-41c2-8be5-3857f518be26 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:46.912479 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:46.925875 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['28a39b92-2011-41b3-9cde-cee66d2ea507'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:10:46.957633 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50965745-d131-468b-9b47-e6036d309a30 req-61d687b5-7b28-449d-b97e-9b7608e0d3ff tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:46.959092 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-50965745-d131-468b-9b47-e6036d309a30 req-61d687b5-7b28-449d-b97e-9b7608e0d3ff tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/networks?id=be546533-cf92-483d-9e38-7d14ca9c4902 HTTP/1.1" status: 200  len: 816 time: 0.2860863
Jun 01 10:10:46.959221 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6775543f-5876-41c2-8be5-3857f518be26 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Pushing event deleted for resources: {'Port': ['ID=28a39b92-2011-41b3-9cde-cee66d2ea507,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:46.968223 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-6775543f-5876-41c2-8be5-3857f518be26 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:46.969179 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-0e3d75f1-0f63-426e-9ed7-35cc40f26c79 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Allocated IP 172.20.0.13 (95462097-1cc6-4207-9add-1b65afcf40ca/abf69321-90c0-4336-ac76-6ef3766e6a67/c6da8fab-3cf3-43a2-aff8-b6f43e149b0a) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:10:47.000632 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9110e246-aac5-470c-8d89-eb8a943fdbff req-add02d9d-a800-4a39-a07f-4827bcad86a1 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:47.000895 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9110e246-aac5-470c-8d89-eb8a943fdbff req-add02d9d-a800-4a39-a07f-4827bcad86a1 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 945 time: 0.2884698
Jun 01 10:10:47.007381 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-50965745-d131-468b-9b47-e6036d309a30 req-d307b81f-ca5f-4c5a-acb4-14da49ef633a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/quotas/f4f6f875519045a39c1fdbadd53ce517 HTTP/1.1" status: 200  len: 375 time: 0.0299718
Jun 01 10:10:47.044141 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [req-4a47f24a-a1dc-4d08-afce-ae3bdd8e44ec req-6775543f-5876-41c2-8be5-3857f518be26 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] No DVR routers for this DVR port 28a39b92-2011-41b3-9cde-cee66d2ea507 on host hv-cinder-78726 {{(pid=92565) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:10:47.047388 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-4a47f24a-a1dc-4d08-afce-ae3bdd8e44ec req-6775543f-5876-41c2-8be5-3857f518be26 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:47.051746 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e427e18a-aa21-4460-8e51-4caa872bb8ee', 'name': 'network-vif-deleted', 'tag': '28a39b92-2011-41b3-9cde-cee66d2ea507'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:10:47.054303 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-24591709-1fc7-47f4-9265-c2319c5a1736" -d '{"events": [{"server_uuid": "e427e18a-aa21-4460-8e51-4caa872bb8ee", "name": "network-vif-deleted", "tag": "28a39b92-2011-41b3-9cde-cee66d2ea507"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:10:47.129369 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9110e246-aac5-470c-8d89-eb8a943fdbff req-1ca1e16f-bee3-41f7-afaa-dfefdc8f4b85 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1210496
Jun 01 10:10:47.131967 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4a47f24a-a1dc-4d08-afce-ae3bdd8e44ec req-6775543f-5876-41c2-8be5-3857f518be26 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.30 "DELETE /v2.0/ports/28a39b92-2011-41b3-9cde-cee66d2ea507 HTTP/1.1" status: 204  len: 173 time: 0.8701432
Jun 01 10:10:47.200812 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:10:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5fee8503-addc-4664-96e2-5b99e7ba0d4c x-openstack-request-id: req-5fee8503-addc-4664-96e2-5b99e7ba0d4c {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:10:47.201695 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e427e18a-aa21-4460-8e51-4caa872bb8ee", "name": "network-vif-deleted", "tag": "28a39b92-2011-41b3-9cde-cee66d2ea507", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:10:47.201987 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-5fee8503-addc-4664-96e2-5b99e7ba0d4c {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:10:47.202466 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e427e18a-aa21-4460-8e51-4caa872bb8ee', 'name': 'network-vif-deleted', 'tag': '28a39b92-2011-41b3-9cde-cee66d2ea507', 'status': 'completed', 'code': 200}
Jun 01 10:10:47.257968 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-50965745-d131-468b-9b47-e6036d309a30 req-1b2b9bab-849a-4bca-b9c0-6f4f31a3561f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Synchronizing usage tracker for tenant:f4f6f875519045a39c1fdbadd53ce517 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:10:47.362617 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-0e3d75f1-0f63-426e-9ed7-35cc40f26c79 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:47.367786 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ebf5d14a-25ce-41a9-8248-a0c1fdf6fe77 req-7417afdb-2aed-43d7-a10f-275260197f26 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 210 time: 0.0526071
Jun 01 10:10:47.373362 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-50965745-d131-468b-9b47-e6036d309a30 req-1b2b9bab-849a-4bca-b9c0-6f4f31a3561f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Unset dirty status for tenant:f4f6f875519045a39c1fdbadd53ce517 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:10:47.374597 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-50965745-d131-468b-9b47-e6036d309a30 req-1b2b9bab-849a-4bca-b9c0-6f4f31a3561f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=f4f6f875519045a39c1fdbadd53ce517&fields=id HTTP/1.1" status: 200  len: 348 time: 0.3380017
Jun 01 10:10:47.520544 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-50965745-d131-468b-9b47-e6036d309a30 req-1f2a1cac-cca7-4292-9f10-0b8b091c17bd service neutron] 10.222.0.68 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1293192
Jun 01 10:10:47.526071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-0e3d75f1-0f63-426e-9ed7-35cc40f26c79 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:47.539464 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['6010d8c0-403f-4393-8c5c-fd9cc14aeecb', '41cda8ce-e474-41cf-9b05-6c4a119eed48'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:10:47.548360 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:47.676224 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-0e3d75f1-0f63-426e-9ed7-35cc40f26c79 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Network 95462097-1cc6-4207-9add-1b65afcf40ca is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:10:47.680715 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-0e3d75f1-0f63-426e-9ed7-35cc40f26c79 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:10:47.687504 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-0e3d75f1-0f63-426e-9ed7-35cc40f26c79 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:10:47.714884 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e3d75f1-0f63-426e-9ed7-35cc40f26c79 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Pushing event updated for resources: {'Port': ['ID=c6da8fab-3cf3-43a2-aff8-b6f43e149b0a,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:47.723548 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-0e3d75f1-0f63-426e-9ed7-35cc40f26c79 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:47.785632 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-0e3d75f1-0f63-426e-9ed7-35cc40f26c79 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:47.786231 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-0e3d75f1-0f63-426e-9ed7-35cc40f26c79 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:47.792637 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-50965745-d131-468b-9b47-e6036d309a30 req-223de3e1-6424-41ef-abc9-c54b2ff7d97a service neutron] 10.222.0.68 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2647495
Jun 01 10:10:47.879215 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-0e3d75f1-0f63-426e-9ed7-35cc40f26c79 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.5292304
Jun 01 10:10:47.901784 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Request body: {'port': {'device_id': '1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:48.020100 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:48.076829 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1d8b04f5-6949-4c5a-bc40-926ce87befb8 req-46032166-30c7-4cc4-8070-33d9fb920a03 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 210 time: 0.0478919
Jun 01 10:10:48.331605 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-15dbfa10-2eb5-4553-826f-7c3258fcd442 req-06e295d4-0377-4a8d-8882-cf04861c8180 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=e427e18a-aa21-4460-8e51-4caa872bb8ee HTTP/1.1" status: 200  len: 210 time: 0.0619583
Jun 01 10:10:48.590696 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c6da8fab-3cf3-43a2-aff8-b6f43e149b0a {{(pid=92566) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:10:48.601802 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:48.623228 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Transition to ACTIVE for port object c6da8fab-3cf3-43a2-aff8-b6f43e149b0a will not be triggered until provisioned by entity L2. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:10:48.637198 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec0f58e6-5f5f-4d27-88f4-46ce8ab51786 req-f08c9603-2857-42b7-a345-9be27b41c655 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:48.637893 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-ec0f58e6-5f5f-4d27-88f4-46ce8ab51786 req-f08c9603-2857-42b7-a345-9be27b41c655 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Synchronizing usage tracker for tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:10:48.726146 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-ec0f58e6-5f5f-4d27-88f4-46ce8ab51786 req-f08c9603-2857-42b7-a345-9be27b41c655 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Unset dirty status for tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:10:48.727355 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ec0f58e6-5f5f-4d27-88f4-46ce8ab51786 req-f08c9603-2857-42b7-a345-9be27b41c655 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 932 time: 0.2109892
Jun 01 10:10:48.727926 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:48.731920 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-fb223670-92c6-42a2-b850-fe00acce7190 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:48.889337 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ec0f58e6-5f5f-4d27-88f4-46ce8ab51786 req-1579e2de-001b-4571-b475-7d2271240f46 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1270692
Jun 01 10:10:48.893727 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Pushing event updated for resources: {'Port': ['ID=c6da8fab-3cf3-43a2-aff8-b6f43e149b0a,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:48.920154 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:48.997744 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Attempting to bind port c6da8fab-3cf3-43a2-aff8-b6f43e149b0a on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:10:48.999459 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Attempting to bind port c6da8fab-3cf3-43a2-aff8-b6f43e149b0a by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': 'f512f187-5724-4ff7-afd5-c422b0bd8ba7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca'}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:10:48.999459 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Attempting to bind port c6da8fab-3cf3-43a2-aff8-b6f43e149b0a on network 95462097-1cc6-4207-9add-1b65afcf40ca {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:10:49.003676 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Port c6da8fab-3cf3-43a2-aff8-b6f43e149b0a on network 95462097-1cc6-4207-9add-1b65afcf40ca not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:10:49.003990 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Attempting to bind port c6da8fab-3cf3-43a2-aff8-b6f43e149b0a on network 95462097-1cc6-4207-9add-1b65afcf40ca {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:10:49.009363 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 10, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:10:49.009690 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Checking segment: {'id': 'f512f187-5724-4ff7-afd5-c422b0bd8ba7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:10:49.010070 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Bound using segment: {'id': 'f512f187-5724-4ff7-afd5-c422b0bd8ba7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca'} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:10:49.010493 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Bound port: c6da8fab-3cf3-43a2-aff8-b6f43e149b0a, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f512f187-5724-4ff7-afd5-c422b0bd8ba7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca'}}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:10:49.010837 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:49.097737 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] For port c6da8fab-3cf3-43a2-aff8-b6f43e149b0a, host hv-cinder-78726, cleared binding levels {{(pid=92566) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:10:49.100708 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] For port c6da8fab-3cf3-43a2-aff8-b6f43e149b0a, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c6da8fab-3cf3-43a2-aff8-b6f43e149b0a,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92566) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:10:49.183103 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:49.187737 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-bdf97ca5-68f7-469f-9e9f-c03c77eb1b9d tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:49.290115 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:49.290892 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:49.292569 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] 10.222.0.30 "PUT /v2.0/ports/c6da8fab-3cf3-43a2-aff8-b6f43e149b0a HTTP/1.1" status: 200  len: 1094 time: 1.3944998
Jun 01 10:10:49.294113 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7bffe1ec-f06c-456f-ae69-945ae2774bec req-8bef93eb-c87c-4ee7-aed2-23260231f146 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 210 time: 0.0724516
Jun 01 10:10:49.294585 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa', 'tag': 'c6da8fab-3cf3-43a2-aff8-b6f43e149b0a'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:10:49.297091 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a94f4f71-33c5-4e9f-a2a6-1240cec715ef" -d '{"events": [{"name": "network-changed", "server_uuid": "1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa", "tag": "c6da8fab-3cf3-43a2-aff8-b6f43e149b0a"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:10:49.324633 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Pushing event updated for resources: {'Port': ['ID=c6da8fab-3cf3-43a2-aff8-b6f43e149b0a,revision_number=3']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:49.328391 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:49.351207 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:10:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d351e07e-c6c6-4eaf-bae7-b6c46744a9e5 x-openstack-request-id: req-d351e07e-c6c6-4eaf-bae7-b6c46744a9e5 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:10:49.351591 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa", "tag": "c6da8fab-3cf3-43a2-aff8-b6f43e149b0a", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:10:49.351826 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-d351e07e-c6c6-4eaf-bae7-b6c46744a9e5 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:10:49.352294 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa', 'tag': 'c6da8fab-3cf3-43a2-aff8-b6f43e149b0a', 'status': 'completed', 'code': 200}
Jun 01 10:10:49.456482 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94f4f71-33c5-4e9f-a2a6-1240cec715ef req-230562fc-e838-49b2-bd2b-1d404c51e95d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:49.458246 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a94f4f71-33c5-4e9f-a2a6-1240cec715ef req-230562fc-e838-49b2-bd2b-1d404c51e95d service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=4f2a9e1dcd084ba7aeb9c96724aea0fe&device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 1097 time: 0.0812180
Jun 01 10:10:49.612328 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94f4f71-33c5-4e9f-a2a6-1240cec715ef req-ffbd8c9a-a3c5-4a20-9556-8b19a8bcaf4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:49.614012 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a94f4f71-33c5-4e9f-a2a6-1240cec715ef req-ffbd8c9a-a3c5-4a20-9556-8b19a8bcaf4b service neutron] 10.222.0.30 "GET /v2.0/networks?tenant_id=4f2a9e1dcd084ba7aeb9c96724aea0fe&shared=False HTTP/1.1" status: 200  len: 916 time: 0.1485240
Jun 01 10:10:49.622893 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 28a39b92-2011-41b3-9cde-cee66d2ea507 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:10:49.662339 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: 28a39b92-2011-41b3-9cde-cee66d2ea507 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:10:49.662696 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 28a39b92-2011-41b3-9cde-cee66d2ea507 not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:10:49.761784 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94f4f71-33c5-4e9f-a2a6-1240cec715ef req-69a73e0e-cf32-48f3-91f2-f4c2f4d73bb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:49.763239 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a94f4f71-33c5-4e9f-a2a6-1240cec715ef req-69a73e0e-cf32-48f3-91f2-f4c2f4d73bb0 service neutron] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1371210
Jun 01 10:10:49.873533 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-b1119d8e-0f4f-4395-823d-e1f83136dcef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:49.875018 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-b1119d8e-0f4f-4395-823d-e1f83136dcef service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=4f2a9e1dcd084ba7aeb9c96724aea0fe&device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 1097 time: 0.0746458
Jun 01 10:10:49.952458 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-67005d4d-1d86-4362-9062-4f54445e9b0b service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=c6da8fab-3cf3-43a2-aff8-b6f43e149b0a HTTP/1.1" status: 200  len: 217 time: 0.0679436
Jun 01 10:10:50.074346 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-9ce0a244-c2f3-406d-809c-108d95e30010 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:50.075739 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-9ce0a244-c2f3-406d-809c-108d95e30010 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=abf69321-90c0-4336-ac76-6ef3766e6a67 HTTP/1.1" status: 200  len: 855 time: 0.1110964
Jun 01 10:10:50.208821 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-3d1f1cab-69c2-4408-8fb0-3c2379f568a2 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=95462097-1cc6-4207-9add-1b65afcf40ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1241417
Jun 01 10:10:50.224018 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-493ac047-ba91-498f-adfa-fb92f4d00a19 req-5e4deab2-13ee-4949-8057-2bb26cee946b tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:50.225417 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-493ac047-ba91-498f-adfa-fb92f4d00a19 req-5e4deab2-13ee-4949-8057-2bb26cee946b tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 944 time: 0.2216051
Jun 01 10:10:50.350679 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-493ac047-ba91-498f-adfa-fb92f4d00a19 req-3c45b7a4-a406-41b4-b804-1bd289834616 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1045527
Jun 01 10:10:50.392199 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-fcd42704-4969-4bc7-b92b-d9343c58390f service neutron] 10.222.0.30 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1658468
Jun 01 10:10:50.463354 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50965745-d131-468b-9b47-e6036d309a30 req-a4177ca2-2031-46ab-9d1e-9a00307e91a3 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:50.465128 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-50965745-d131-468b-9b47-e6036d309a30 req-a4177ca2-2031-46ab-9d1e-9a00307e91a3 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.30 "GET /v2.0/networks?id=be546533-cf92-483d-9e38-7d14ca9c4902 HTTP/1.1" status: 200  len: 816 time: 0.1517432
Jun 01 10:10:50.472381 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3e718dfc-439e-4f45-a0e1-7dea6aac873a req-8f7ef33b-7f77-4f67-a912-a724b77f73bd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 210 time: 0.0438035
Jun 01 10:10:50.797391 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-ac10e26a-21d4-4a6b-9a34-32900cc6f820 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Synchronizing usage tracker for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:security_group {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:10:50.879856 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-ac10e26a-21d4-4a6b-9a34-32900cc6f820 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Unset dirty status for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:security_group {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:10:50.880966 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-ac10e26a-21d4-4a6b-9a34-32900cc6f820 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-881588482&fields=id&tenant_id=cfa9132b1ba044548228b96f6c2755eb HTTP/1.1" status: 200  len: 267 time: 0.1251047
Jun 01 10:10:51.031475 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-f82091a9-ff8f-4350-9831-94043a15d73f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:51.032160 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-f82091a9-ff8f-4350-9831-94043a15d73f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Synchronizing usage tracker for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:network {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:10:51.131262 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-f82091a9-ff8f-4350-9831-94043a15d73f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Unset dirty status for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:network {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:10:51.132481 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-f82091a9-ff8f-4350-9831-94043a15d73f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/networks?id=83aff072-8820-4a36-b8f3-036a7011aace HTTP/1.1" status: 200  len: 809 time: 0.2448466
Jun 01 10:10:51.148716 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-e570c04d-7174-4346-827f-183e6317555e tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/quotas/cfa9132b1ba044548228b96f6c2755eb HTTP/1.1" status: 200  len: 375 time: 0.0098436
Jun 01 10:10:51.234366 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-ad96409e-f46e-4892-91c7-e01921793f1f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0794952
Jun 01 10:10:51.372719 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-3d0876ab-48f4-4dff-98d0-e196f117a18b service neutron] 10.222.0.68 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1269443
Jun 01 10:10:51.558528 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-18938369-e1c9-4354-9cab-d84d12fe1459 service neutron] 10.222.0.68 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1793432
Jun 01 10:10:51.578787 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05a9840c-b437-45f5-b79c-f5c1852402b0 req-f30f6275-ccd2-4862-9b08-53a5ef79e4b9 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:51.580253 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-05a9840c-b437-45f5-b79c-f5c1852402b0 req-f30f6275-ccd2-4862-9b08-53a5ef79e4b9 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 944 time: 0.1141937
Jun 01 10:10:51.628886 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-05a9840c-b437-45f5-b79c-f5c1852402b0 req-2828c67b-ecd5-4737-ae8b-925be1d94777 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427973
Jun 01 10:10:51.763251 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f482d228-c93f-4ed9-9ce7-eba13988537d req-a7366700-e0c8-49d9-b02f-eb1c91d99bc7 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 210 time: 0.0437126
Jun 01 10:10:52.266162 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e3b2e872-26b8-4c59-a712-ab974250a613 req-3570c40d-d201-475a-b963-00c72b1aa288 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 210 time: 0.0426955
Jun 01 10:10:52.822671 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49edbc1f-8cba-4ea7-b0c8-d2e14011ccb6 req-c95ac439-69de-4a32-aa42-0b6aeb9a08a7 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:52.824162 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-49edbc1f-8cba-4ea7-b0c8-d2e14011ccb6 req-c95ac439-69de-4a32-aa42-0b6aeb9a08a7 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 944 time: 0.0855978
Jun 01 10:10:52.869478 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-49edbc1f-8cba-4ea7-b0c8-d2e14011ccb6 req-9de38658-24be-4b60-9477-f0e467119b18 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388217
Jun 01 10:10:52.922867 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-31b1ef23-cd60-43f8-8620-c186e4931644 req-838d6775-0d8b-4b9d-a101-be90867cbbd5 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 210 time: 0.0421000
Jun 01 10:10:53.229811 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-50965745-d131-468b-9b47-e6036d309a30 req-b09c4e1b-8d68-44ed-9edc-0de0857843f3 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f4f6f875519045a39c1fdbadd53ce517 HTTP/1.1" status: 200  len: 379 time: 0.0415831
Jun 01 10:10:53.239770 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [req-50965745-d131-468b-9b47-e6036d309a30 req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Request body: {'port': {'device_id': 'e0043671-b417-407f-944f-21d4e3af4137', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'admin_state_up': True, 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'security_groups': ['0a1ee7c6-132b-4e91-9d58-cd0c0ebba815']}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:53.325868 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a080e24e-26f5-4066-96ae-ceab70d7ece4 req-68e4403a-2a6b-4a7d-9943-e8af4e8d4b7a service neutron] 10.222.0.30 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1469674
Jun 01 10:10:53.380055 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [req-50965745-d131-468b-9b47-e6036d309a30 req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:53.389914 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [req-50965745-d131-468b-9b47-e6036d309a30 req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:53.429760 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-387dfa46-9416-4a67-bc6c-4eff45b7b23d req-a7f8e68e-24c3-4443-83e4-b60b592d013d tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 210 time: 0.0423574
Jun 01 10:10:53.469250 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-50965745-d131-468b-9b47-e6036d309a30 req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Made reservation on behalf of f4f6f875519045a39c1fdbadd53ce517 for: {'port': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:10:53.472980 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-50965745-d131-468b-9b47-e6036d309a30 req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:53.642177 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [req-50965745-d131-468b-9b47-e6036d309a30 req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Allocated IP 172.20.0.8 (be546533-cf92-483d-9e38-7d14ca9c4902/f2fdda64-a03c-41d7-8178-daca0363bd6e/15ce50f0-fa11-464b-a55e-f6f214c49154) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:10:53.846148 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-50965745-d131-468b-9b47-e6036d309a30 req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:53.861810 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.provisioning_blocks [req-50965745-d131-468b-9b47-e6036d309a30 req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Transition to ACTIVE for port object 15ce50f0-fa11-464b-a55e-f6f214c49154 will not be triggered until provisioned by entity DHCP. {{(pid=92565) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:10:53.965432 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-50965745-d131-468b-9b47-e6036d309a30 req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:53.972412 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:54.133757 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba26a1d5-60d4-4ca1-b783-15b8969447a9 req-864adc7d-3bce-422a-8906-81b03e31e8df tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:54.141910 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-50965745-d131-468b-9b47-e6036d309a30 req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Network be546533-cf92-483d-9e38-7d14ca9c4902 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:10:54.142701 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ba26a1d5-60d4-4ca1-b783-15b8969447a9 req-864adc7d-3bce-422a-8906-81b03e31e8df tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 944 time: 0.1606941
Jun 01 10:10:54.146000 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [req-50965745-d131-468b-9b47-e6036d309a30 req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:10:54.157226 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [req-50965745-d131-468b-9b47-e6036d309a30 req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:10:54.194972 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event updated for resources: {'Port': ['ID=15ce50f0-fa11-464b-a55e-f6f214c49154,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:54.200034 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:54.208529 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ba26a1d5-60d4-4ca1-b783-15b8969447a9 req-54e6a03a-1eb4-4e5d-9b76-83ef9c964344 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0638897
Jun 01 10:10:54.221699 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7447fa0-7b93-4089-a279-a2b6a13ee0fa req-5eb892ec-1464-4457-bd8e-3c96182301a9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:54.223249 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e7447fa0-7b93-4089-a279-a2b6a13ee0fa req-5eb892ec-1464-4457-bd8e-3c96182301a9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 931 time: 0.1696711
Jun 01 10:10:54.239294 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50965745-d131-468b-9b47-e6036d309a30 req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:54.239948 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-50965745-d131-468b-9b47-e6036d309a30 req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:54.273596 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e7447fa0-7b93-4089-a279-a2b6a13ee0fa req-bca87f65-14cb-4bd8-a971-60fc6ec153b6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0445421
Jun 01 10:10:54.383364 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-50965745-d131-468b-9b47-e6036d309a30 req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.1473656
Jun 01 10:10:54.400601 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Request body: {'port': {'device_id': 'e0043671-b417-407f-944f-21d4e3af4137', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:54.508165 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-e6337bad-e9f6-4442-97a2-3ae22265c967 None None] Provisioning for port 15ce50f0-fa11-464b-a55e-f6f214c49154 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:10:54.513171 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-e6337bad-e9f6-4442-97a2-3ae22265c967 None None] Provisioning complete for port 15ce50f0-fa11-464b-a55e-f6f214c49154 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:54.514282 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-e6337bad-e9f6-4442-97a2-3ae22265c967 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:54.524947 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:54.577622 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-e6337bad-e9f6-4442-97a2-3ae22265c967 None None] Port 15ce50f0-fa11-464b-a55e-f6f214c49154 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:10:54.599069 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c11a1147-b5fa-4df6-a0f6-ae3127afd22f req-e9ca39d1-3e7f-4124-bfe9-af5cdd324707 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 210 time: 0.0482194
Jun 01 10:10:54.854213 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-b36eb8e9-82df-4080-953b-72be64864912 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:54.855724 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-b36eb8e9-82df-4080-953b-72be64864912 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.30 "GET /v2.0/networks?id=83aff072-8820-4a36-b8f3-036a7011aace HTTP/1.1" status: 200  len: 809 time: 0.2306118
Jun 01 10:10:54.891737 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 15ce50f0-fa11-464b-a55e-f6f214c49154 {{(pid=92565) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:10:54.899442 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:54.908477 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-81734301-dfee-4ed5-83df-676aaa692347 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=cfa9132b1ba044548228b96f6c2755eb HTTP/1.1" status: 200  len: 379 time: 0.0429776
Jun 01 10:10:54.914507 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.provisioning_blocks [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Transition to ACTIVE for port object 15ce50f0-fa11-464b-a55e-f6f214c49154 will not be triggered until provisioned by entity L2. {{(pid=92565) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:10:54.917836 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Request body: {'port': {'device_id': '4a01bc46-d5a0-4ef7-9aff-f160ee9d943f', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'admin_state_up': True, 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'security_groups': ['53e3d69f-76f1-4e9a-808e-b6a7c88db3f4']}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:55.026738 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2295697'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:55.033589 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-79a0c480-6665-45fe-aa5f-94e89578b7ab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:55.055362 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:10:55.060243 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Usage tracker for resource:port and tenant:cfa9132b1ba044548228b96f6c2755eb is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:10:55.064921 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Quota usage for port was recalculated. Used quota:2. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:10:55.072526 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:10:55.148789 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Made reservation on behalf of cfa9132b1ba044548228b96f6c2755eb for: {'port': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:10:55.153034 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:55.204398 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Pushing event updated for resources: {'Port': ['ID=15ce50f0-fa11-464b-a55e-f6f214c49154,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:55.234182 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:55.300004 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Attempting to bind port 15ce50f0-fa11-464b-a55e-f6f214c49154 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:10:55.300861 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Attempting to bind port 15ce50f0-fa11-464b-a55e-f6f214c49154 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '718fdfa6-b13d-46f9-85ca-8438bc5d308c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902'}] {{(pid=92565) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:10:55.300861 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Attempting to bind port 15ce50f0-fa11-464b-a55e-f6f214c49154 on network be546533-cf92-483d-9e38-7d14ca9c4902 {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:10:55.307273 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Port 15ce50f0-fa11-464b-a55e-f6f214c49154 on network be546533-cf92-483d-9e38-7d14ca9c4902 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:10:55.307753 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Attempting to bind port 15ce50f0-fa11-464b-a55e-f6f214c49154 on network be546533-cf92-483d-9e38-7d14ca9c4902 {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:10:55.314488 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 10, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:10:55.314995 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Checking segment: {'id': '718fdfa6-b13d-46f9-85ca-8438bc5d308c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92565) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:10:55.315390 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Bound using segment: {'id': '718fdfa6-b13d-46f9-85ca-8438bc5d308c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902'} {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:10:55.315831 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Bound port: 15ce50f0-fa11-464b-a55e-f6f214c49154, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '718fdfa6-b13d-46f9-85ca-8438bc5d308c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902'}}] {{(pid=92565) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:10:55.316226 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:55.356996 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Allocated IP 172.20.0.13 (83aff072-8820-4a36-b8f3-036a7011aace/38dbf18a-9bde-4c4a-b149-d02ad12671d3/435c6b97-3648-4e27-92c7-12447506ef9f) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:10:55.424853 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] For port 15ce50f0-fa11-464b-a55e-f6f214c49154, host hv-cinder-78726, cleared binding levels {{(pid=92565) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:10:55.428334 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] For port 15ce50f0-fa11-464b-a55e-f6f214c49154, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=15ce50f0-fa11-464b-a55e-f6f214c49154,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92565) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:10:55.554664 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2295697'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:55.559537 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:55.616821 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:55.617440 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:55.618823 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-50965745-d131-468b-9b47-e6036d309a30 req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] 10.222.0.30 "PUT /v2.0/ports/15ce50f0-fa11-464b-a55e-f6f214c49154 HTTP/1.1" status: 200  len: 1093 time: 1.2230525
Jun 01 10:10:55.619356 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e0043671-b417-407f-944f-21d4e3af4137', 'tag': '15ce50f0-fa11-464b-a55e-f6f214c49154'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:10:55.621864 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0fb21284-939d-46e5-8f9c-529430778ab4" -d '{"events": [{"name": "network-changed", "server_uuid": "e0043671-b417-407f-944f-21d4e3af4137", "tag": "15ce50f0-fa11-464b-a55e-f6f214c49154"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:10:55.638004 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device c6da8fab-3cf3-43a2-aff8-b6f43e149b0a details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:10:55.645029 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Pushing event updated for resources: {'Port': ['ID=15ce50f0-fa11-464b-a55e-f6f214c49154,revision_number=3']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:55.648340 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:55.757486 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:55.769733 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c126e41-700a-4537-bc7b-36b25b0717f8 req-7b1eb3fa-5ec5-446f-a73a-17e07403cddd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:55.771404 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2c126e41-700a-4537-bc7b-36b25b0717f8 req-7b1eb3fa-5ec5-446f-a73a-17e07403cddd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.3443124
Jun 01 10:10:55.821460 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d840286-b50f-49b8-b8f3-7869633144ad req-91298770-6b3e-4f31-9b2f-0913fd2d537e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:55.823425 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8d840286-b50f-49b8-b8f3-7869633144ad req-91298770-6b3e-4f31-9b2f-0913fd2d537e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 944 time: 0.3267860
Jun 01 10:10:55.858698 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port c6da8fab-3cf3-43a2-aff8-b6f43e149b0a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c6da8fab-3cf3-43a2-aff8-b6f43e149b0a,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:10:55.862708 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Transition to ACTIVE for port object 435c6b97-3648-4e27-92c7-12447506ef9f will not be triggered until provisioned by entity DHCP. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:10:55.867025 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2c126e41-700a-4537-bc7b-36b25b0717f8 req-6e48fe96-97c0-4dc1-af2a-5aa94e5fa78c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0874722
Jun 01 10:10:55.877751 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': 'c6da8fab-3cf3-43a2-aff8-b6f43e149b0a', 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca', 'port_id': 'c6da8fab-3cf3-43a2-aff8-b6f43e149b0a', 'mac_address': 'fa:16:3e:ec:01:97', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 897, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'abf69321-90c0-4336-ac76-6ef3766e6a67', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:10:55.906702 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50965745-d131-468b-9b47-e6036d309a30 req-538e6459-0a3f-470c-84ab-d4990528986c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:55.912675 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-50965745-d131-468b-9b47-e6036d309a30 req-538e6459-0a3f-470c-84ab-d4990528986c service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=f4f6f875519045a39c1fdbadd53ce517&device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 1096 time: 0.1490455
Jun 01 10:10:55.919515 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8d840286-b50f-49b8-b8f3-7869633144ad req-5bfb09f7-0f5a-4ddd-a603-5fac42c2ce09 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0814819
Jun 01 10:10:55.955150 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:55.975686 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c6da8fab-3cf3-43a2-aff8-b6f43e149b0a {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:10:55.996486 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port c6da8fab-3cf3-43a2-aff8-b6f43e149b0a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c6da8fab-3cf3-43a2-aff8-b6f43e149b0a,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:10:55.999665 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:10:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2bbb6134-92b1-44e5-9875-73f6d26b58ee x-openstack-request-id: req-2bbb6134-92b1-44e5-9875-73f6d26b58ee {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:10:56.004157 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e0043671-b417-407f-944f-21d4e3af4137", "tag": "15ce50f0-fa11-464b-a55e-f6f214c49154", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:10:56.004157 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-2bbb6134-92b1-44e5-9875-73f6d26b58ee {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:10:56.004157 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e0043671-b417-407f-944f-21d4e3af4137', 'tag': '15ce50f0-fa11-464b-a55e-f6f214c49154', 'status': 'completed', 'code': 200}
Jun 01 10:10:56.009752 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-50965745-d131-468b-9b47-e6036d309a30 req-5d6f41a0-6828-4d5a-b63e-b60de8c04679 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=15ce50f0-fa11-464b-a55e-f6f214c49154 HTTP/1.1" status: 200  len: 217 time: 0.0907738
Jun 01 10:10:56.036025 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:56.051815 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-c2554238-3885-4b19-b7b2-b91c1cce8f5e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:56.079177 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50965745-d131-468b-9b47-e6036d309a30 req-c8fa7373-4825-4858-9450-f8da1f220a27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:56.080407 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:56.080623 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-50965745-d131-468b-9b47-e6036d309a30 req-c8fa7373-4825-4858-9450-f8da1f220a27 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=f2fdda64-a03c-41d7-8178-daca0363bd6e HTTP/1.1" status: 200  len: 855 time: 0.0625224
Jun 01 10:10:56.082308 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:56.133366 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Network 83aff072-8820-4a36-b8f3-036a7011aace is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:10:56.151409 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:10:56.154323 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:10:56.185218 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50965745-d131-468b-9b47-e6036d309a30 req-ed07bed9-9385-43be-94b1-8a6beb650b17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:56.191267 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-50965745-d131-468b-9b47-e6036d309a30 req-ed07bed9-9385-43be-94b1-8a6beb650b17 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=be546533-cf92-483d-9e38-7d14ca9c4902&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0966766
Jun 01 10:10:56.192090 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=c6da8fab-3cf3-43a2-aff8-b6f43e149b0a,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:56.195137 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:56.208825 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event updated for resources: {'Port': ['ID=435c6b97-3648-4e27-92c7-12447506ef9f,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:56.214521 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:56.256917 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:56.256917 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:56.276603 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55876995-6433-49b2-bdff-6751c4f00616 req-cc064a66-dcdf-47c2-b041-556acd1d39df tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:56.283397 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-55876995-6433-49b2-bdff-6751c4f00616 req-cc064a66-dcdf-47c2-b041-556acd1d39df tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 932 time: 0.2960865
Jun 01 10:10:56.346826 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-50965745-d131-468b-9b47-e6036d309a30 req-7c92f584-8d8d-4957-ba80-98e7505dcaf6 service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1482134
Jun 01 10:10:56.349690 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-55876995-6433-49b2-bdff-6751c4f00616 req-f6992372-3617-4717-a192-a5c908b9cdf5 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0653505
Jun 01 10:10:56.359720 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['c6da8fab-3cf3-43a2-aff8-b6f43e149b0a'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:10:56.372392 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.4555516
Jun 01 10:10:56.382515 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Request body: {'port': {'device_id': '4a01bc46-d5a0-4ef7-9aff-f160ee9d943f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:10:56.516201 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-50965745-d131-468b-9b47-e6036d309a30 req-46ad8c4e-0dd9-4432-933d-dda65de012a7 service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1604238
Jun 01 10:10:56.517547 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:56.528836 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:56.605576 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-4d6cdc80-63ec-42e9-8a0b-779959693b12 None None] Provisioning for port 435c6b97-3648-4e27-92c7-12447506ef9f completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:10:56.612530 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-4d6cdc80-63ec-42e9-8a0b-779959693b12 None None] Provisioning complete for port 435c6b97-3648-4e27-92c7-12447506ef9f triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:10:56.613085 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-4d6cdc80-63ec-42e9-8a0b-779959693b12 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:56.695269 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-4d6cdc80-63ec-42e9-8a0b-779959693b12 None None] Port 435c6b97-3648-4e27-92c7-12447506ef9f cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:10:56.739019 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fb21284-939d-46e5-8f9c-529430778ab4 req-f4b1f65d-65e6-4de8-b4d7-ac40da672840 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:56.740610 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-0fb21284-939d-46e5-8f9c-529430778ab4 req-f4b1f65d-65e6-4de8-b4d7-ac40da672840 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=f4f6f875519045a39c1fdbadd53ce517&device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 1096 time: 0.0778613
Jun 01 10:10:56.879461 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 435c6b97-3648-4e27-92c7-12447506ef9f {{(pid=92566) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:10:56.886715 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:56.907503 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Transition to ACTIVE for port object 435c6b97-3648-4e27-92c7-12447506ef9f will not be triggered until provisioned by entity L2. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:10:56.974373 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fb21284-939d-46e5-8f9c-529430778ab4 req-320a00b4-11ac-4cd0-b352-d3e189d9d117 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:56.975990 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-0fb21284-939d-46e5-8f9c-529430778ab4 req-320a00b4-11ac-4cd0-b352-d3e189d9d117 service neutron] 10.222.0.30 "GET /v2.0/networks?id=be546533-cf92-483d-9e38-7d14ca9c4902 HTTP/1.1" status: 200  len: 917 time: 0.2249348
Jun 01 10:10:56.982500 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:56.986706 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:57.277643 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Pushing event updated for resources: {'Port': ['ID=435c6b97-3648-4e27-92c7-12447506ef9f,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:57.288976 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.302s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:57.424163 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eae7c38-1ee9-47a6-916c-60f030263443 req-049a46ec-f6f7-4345-bd98-48a9057c665f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:57.425651 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5eae7c38-1ee9-47a6-916c-60f030263443 req-049a46ec-f6f7-4345-bd98-48a9057c665f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.4044867
Jun 01 10:10:57.435576 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1dc6f41-b97f-4f98-8948-6a473613cf14 req-24eed828-127f-4082-b9db-126a778ca0d2 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:57.440859 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c1dc6f41-b97f-4f98-8948-6a473613cf14 req-24eed828-127f-4082-b9db-126a778ca0d2 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 945 time: 0.3671582
Jun 01 10:10:57.458599 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Attempting to bind port 435c6b97-3648-4e27-92c7-12447506ef9f on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:10:57.458862 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Attempting to bind port 435c6b97-3648-4e27-92c7-12447506ef9f by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:10:57.459214 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Attempting to bind port 435c6b97-3648-4e27-92c7-12447506ef9f on network 83aff072-8820-4a36-b8f3-036a7011aace {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:10:57.492129 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Port 435c6b97-3648-4e27-92c7-12447506ef9f on network 83aff072-8820-4a36-b8f3-036a7011aace not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:10:57.492466 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Attempting to bind port 435c6b97-3648-4e27-92c7-12447506ef9f on network 83aff072-8820-4a36-b8f3-036a7011aace {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:10:57.510623 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 10, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:10:57.510983 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Checking segment: {'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:10:57.511366 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Bound using segment: {'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:10:57.511793 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Bound port: 435c6b97-3648-4e27-92c7-12447506ef9f, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'}}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:10:57.512138 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:57.530576 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5eae7c38-1ee9-47a6-916c-60f030263443 req-65058f30-3148-41fe-9f49-25c727f97ffd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0919743
Jun 01 10:10:57.541970 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c1dc6f41-b97f-4f98-8948-6a473613cf14 req-a7fd2607-9397-451b-9d6e-a2756453c4d7 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0843806
Jun 01 10:10:57.620601 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] For port 435c6b97-3648-4e27-92c7-12447506ef9f, host hv-cinder-78726, cleared binding levels {{(pid=92566) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:10:57.623621 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] For port 435c6b97-3648-4e27-92c7-12447506ef9f, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=435c6b97-3648-4e27-92c7-12447506ef9f,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92566) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:10:57.685935 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:57.691416 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:10:57.756174 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:57.756790 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:10:57.758140 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] 10.222.0.30 "PUT /v2.0/ports/435c6b97-3648-4e27-92c7-12447506ef9f HTTP/1.1" status: 200  len: 1094 time: 1.3804576
Jun 01 10:10:57.758627 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4a01bc46-d5a0-4ef7-9aff-f160ee9d943f', 'tag': '435c6b97-3648-4e27-92c7-12447506ef9f'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:10:57.760857 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-40b94ade-515c-44b4-8e6a-526ada4fc99f" -d '{"events": [{"name": "network-changed", "server_uuid": "4a01bc46-d5a0-4ef7-9aff-f160ee9d943f", "tag": "435c6b97-3648-4e27-92c7-12447506ef9f"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:10:57.766451 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-0fb21284-939d-46e5-8f9c-529430778ab4 req-3d0ca3a0-1738-4085-b8dd-95ae8228ac4f service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=15ce50f0-fa11-464b-a55e-f6f214c49154 HTTP/1.1" status: 200  len: 217 time: 0.0727034
Jun 01 10:10:57.792106 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e042331e-baf0-41a5-9a9a-6cdbd430cdb0 req-707c781f-637c-4230-982c-bdd8b6fa34db tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:57.792836 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-e042331e-baf0-41a5-9a9a-6cdbd430cdb0 req-707c781f-637c-4230-982c-bdd8b6fa34db tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Synchronizing usage tracker for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:10:57.801633 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Pushing event updated for resources: {'Port': ['ID=435c6b97-3648-4e27-92c7-12447506ef9f,revision_number=3']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:10:57.807607 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:10:57.818050 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:10:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-56bf31a6-7d70-4eb6-91d1-16190864d6e8 x-openstack-request-id: req-56bf31a6-7d70-4eb6-91d1-16190864d6e8 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:10:57.818436 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4a01bc46-d5a0-4ef7-9aff-f160ee9d943f", "tag": "435c6b97-3648-4e27-92c7-12447506ef9f", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:10:57.818778 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-56bf31a6-7d70-4eb6-91d1-16190864d6e8 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:10:57.819359 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4a01bc46-d5a0-4ef7-9aff-f160ee9d943f', 'tag': '435c6b97-3648-4e27-92c7-12447506ef9f', 'status': 'completed', 'code': 200}
Jun 01 10:10:57.897381 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-e042331e-baf0-41a5-9a9a-6cdbd430cdb0 req-707c781f-637c-4230-982c-bdd8b6fa34db tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Unset dirty status for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:10:57.898796 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e042331e-baf0-41a5-9a9a-6cdbd430cdb0 req-707c781f-637c-4230-982c-bdd8b6fa34db tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 944 time: 0.2689159
Jun 01 10:10:57.950424 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e042331e-baf0-41a5-9a9a-6cdbd430cdb0 req-b6219ce3-7e1a-44a4-bf62-f07659149369 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0455885
Jun 01 10:10:58.788083 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-510375c5-169f-461a-b978-79ae79171b63 req-188388e6-36f5-43d8-9527-63814f056189 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:58.789515 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-510375c5-169f-461a-b978-79ae79171b63 req-188388e6-36f5-43d8-9527-63814f056189 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.1409388
Jun 01 10:10:58.797178 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e65f30c7-da91-476e-a102-bd9795e246c8 req-c235a90a-aa70-41aa-92db-0cba43d9ef94 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:58.798490 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e65f30c7-da91-476e-a102-bd9795e246c8 req-c235a90a-aa70-41aa-92db-0cba43d9ef94 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 945 time: 0.1143219
Jun 01 10:10:58.865338 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-510375c5-169f-461a-b978-79ae79171b63 req-8495a170-b015-4510-b6dc-2c6f5c1178f8 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0659094
Jun 01 10:10:58.869726 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e65f30c7-da91-476e-a102-bd9795e246c8 req-4184ad30-5281-4e50-ba2c-8cdae942cd8a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0573220
Jun 01 10:10:59.132940 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3424ec98-7f84-498d-954a-4e119ba2d7ab req-9d6f6f00-c795-4987-bac6-243fbb86b7dd tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:59.134289 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3424ec98-7f84-498d-954a-4e119ba2d7ab req-9d6f6f00-c795-4987-bac6-243fbb86b7dd tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 944 time: 0.0799358
Jun 01 10:10:59.180685 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3424ec98-7f84-498d-954a-4e119ba2d7ab req-fce2b32b-af3f-412f-bc46-1cd7bd810f95 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0407553
Jun 01 10:10:59.658463 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fb21284-939d-46e5-8f9c-529430778ab4 req-6c632fcb-972e-4dd7-ab8e-b976d7b7cf59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:59.659958 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-0fb21284-939d-46e5-8f9c-529430778ab4 req-6c632fcb-972e-4dd7-ab8e-b976d7b7cf59 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=f2fdda64-a03c-41d7-8178-daca0363bd6e HTTP/1.1" status: 200  len: 855 time: 0.0660319
Jun 01 10:10:59.679407 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40b94ade-515c-44b4-8e6a-526ada4fc99f req-c6257dc0-7f7f-451b-a0b7-02aa38d1c4b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:59.680849 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-40b94ade-515c-44b4-8e6a-526ada4fc99f req-c6257dc0-7f7f-451b-a0b7-02aa38d1c4b5 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 1097 time: 0.0734046
Jun 01 10:10:59.737911 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fb21284-939d-46e5-8f9c-529430778ab4 req-dcd08e28-f671-4cd4-a6e6-5e8cd9ed8722 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:59.742872 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-0fb21284-939d-46e5-8f9c-529430778ab4 req-dcd08e28-f671-4cd4-a6e6-5e8cd9ed8722 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=be546533-cf92-483d-9e38-7d14ca9c4902&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0721536
Jun 01 10:10:59.824071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40b94ade-515c-44b4-8e6a-526ada4fc99f req-fa7e6706-64b0-43c9-8507-05276cf5322e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:59.825552 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-40b94ade-515c-44b4-8e6a-526ada4fc99f req-fa7e6706-64b0-43c9-8507-05276cf5322e service neutron] 10.222.0.30 "GET /v2.0/networks?tenant_id=cfa9132b1ba044548228b96f6c2755eb&shared=False HTTP/1.1" status: 200  len: 910 time: 0.1366658
Jun 01 10:10:59.874790 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-0fb21284-939d-46e5-8f9c-529430778ab4 req-2c1d8790-d96a-4d95-bcc0-cb36ed2645ba service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1272962
Jun 01 10:10:59.975850 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40b94ade-515c-44b4-8e6a-526ada4fc99f req-4fe10793-a918-40e7-b847-2fd349a7098d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:10:59.977298 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-40b94ade-515c-44b4-8e6a-526ada4fc99f req-4fe10793-a918-40e7-b847-2fd349a7098d service neutron] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1450112
Jun 01 10:11:00.025996 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-0fb21284-939d-46e5-8f9c-529430778ab4 req-ae8d27f0-6b2e-49a9-8e68-de552370c48f service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1419566
Jun 01 10:11:00.191605 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e6f919b-3d5d-4f34-8b88-cb3d33c6a820 req-8f37e813-2c6d-4d72-8cd5-abf4b53dd14a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:00.193047 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6e6f919b-3d5d-4f34-8b88-cb3d33c6a820 req-8f37e813-2c6d-4d72-8cd5-abf4b53dd14a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.1996453
Jun 01 10:11:00.195060 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-450d6ddd-bba9-4e79-ba39-ec80bb5b072e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:00.196377 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-450d6ddd-bba9-4e79-ba39-ec80bb5b072e service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 1097 time: 0.1664400
Jun 01 10:11:00.204143 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7a314ed-7309-4b0d-91bf-51060c418e50 req-557ab140-ffcf-42ff-9ffb-f027e519f28d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:00.205478 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e7a314ed-7309-4b0d-91bf-51060c418e50 req-557ab140-ffcf-42ff-9ffb-f027e519f28d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 945 time: 0.1813309
Jun 01 10:11:00.297062 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-85391900-7d6f-4935-a853-ee377afa7342 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=435c6b97-3648-4e27-92c7-12447506ef9f HTTP/1.1" status: 200  len: 217 time: 0.0895247
Jun 01 10:11:00.453953 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e7a314ed-7309-4b0d-91bf-51060c418e50 req-ed23f59c-75bc-4aec-8209-134da3acfb7b tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1825588
Jun 01 10:11:00.456455 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6e6f919b-3d5d-4f34-8b88-cb3d33c6a820 req-73b7f88f-1686-482a-b2a8-cde04d20ec96 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2501416
Jun 01 10:11:00.471695 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-2a209359-62bb-4f89-92d8-bf1de46d6fa9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:00.479322 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-2a209359-62bb-4f89-92d8-bf1de46d6fa9 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=38dbf18a-9bde-4c4a-b149-d02ad12671d3 HTTP/1.1" status: 200  len: 848 time: 0.1645629
Jun 01 10:11:00.587905 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-92810209-015f-4031-b2a7-6362f3aaec25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:00.589340 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-92810209-015f-4031-b2a7-6362f3aaec25 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=83aff072-8820-4a36-b8f3-036a7011aace&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1088691
Jun 01 10:11:00.753084 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86bfda6f-9e06-4b40-869b-ecff686fb45a req-757fd74b-f62c-4eb3-9f4a-89ca08a09854 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:00.754509 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-86bfda6f-9e06-4b40-869b-ecff686fb45a req-757fd74b-f62c-4eb3-9f4a-89ca08a09854 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 944 time: 0.1987331
Jun 01 10:11:00.793784 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-53511088-8c2a-40e6-bb9e-1922cfba9e40 service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1908324
Jun 01 10:11:00.967095 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-86bfda6f-9e06-4b40-869b-ecff686fb45a req-32fbd3d8-1dfe-423d-b6f7-0b44a0c0935b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1934364
Jun 01 10:11:01.032971 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-96d97fd2-e3ea-424d-8dda-80d9d98a38b7 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:01.034377 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-96d97fd2-e3ea-424d-8dda-80d9d98a38b7 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/networks?id=3a2e5ab1-9bd9-4597-be91-953ea2afbf4b HTTP/1.1" status: 200  len: 813 time: 0.2929842
Jun 01 10:11:01.043363 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa9a1401-5bb8-492b-ab51-b590644d980d req-638260bf-89ac-4af4-9f8e-1da2036d92b8 service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1979189
Jun 01 10:11:01.051786 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-688c1f57-d121-4801-bd2c-527acae180e8 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/quotas/80c0fea786fd4fb9afd054ddb2559c2a HTTP/1.1" status: 200  len: 375 time: 0.0112402
Jun 01 10:11:01.099087 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-4f095c04-c473-48a8-8b15-18c0f60910de tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=80c0fea786fd4fb9afd054ddb2559c2a&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0418184
Jun 01 10:11:01.228552 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-143e71c6-6c69-437d-a910-487cc8bfaac9 service neutron] 10.222.0.68 "GET /v2.0/networks/3a2e5ab1-9bd9-4597-be91-953ea2afbf4b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1227767
Jun 01 10:11:01.358775 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-5efe1608-3e70-48d6-b052-feaaa54347b9 service neutron] 10.222.0.68 "GET /v2.0/networks/3a2e5ab1-9bd9-4597-be91-953ea2afbf4b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1239259
Jun 01 10:11:01.685211 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 15ce50f0-fa11-464b-a55e-f6f214c49154 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:11:01.688350 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device c6da8fab-3cf3-43a2-aff8-b6f43e149b0a up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:11:01.706262 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5eb34a6-d52b-4565-8132-ac13fd03a89f req-75e82e85-b950-4a73-b4ae-802ed7e79be8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:01.707751 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d5eb34a6-d52b-4565-8132-ac13fd03a89f req-75e82e85-b950-4a73-b4ae-802ed7e79be8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 945 time: 0.1466084
Jun 01 10:11:01.719534 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-993096f8-9fe3-4add-b18a-2bbd378c8af7 req-2327a137-b548-47a9-8f85-ee164d72e191 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:01.720923 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-993096f8-9fe3-4add-b18a-2bbd378c8af7 req-2327a137-b548-47a9-8f85-ee164d72e191 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.1090009
Jun 01 10:11:01.792690 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d5eb34a6-d52b-4565-8132-ac13fd03a89f req-10e557d1-1bf8-4168-9f71-5019c927ff1f tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0708294
Jun 01 10:11:01.797016 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-993096f8-9fe3-4add-b18a-2bbd378c8af7 req-d57f1cd5-79e4-4e28-a468-9b8653a36c81 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0608943
Jun 01 10:11:01.882806 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 15ce50f0-fa11-464b-a55e-f6f214c49154, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=15ce50f0-fa11-464b-a55e-f6f214c49154,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:01.893569 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port c6da8fab-3cf3-43a2-aff8-b6f43e149b0a completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:11:01.900837 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': '15ce50f0-fa11-464b-a55e-f6f214c49154', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'port_id': '15ce50f0-fa11-464b-a55e-f6f214c49154', 'mac_address': 'fa:16:3e:9f:c6:d9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 861, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:11:01.902465 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port c6da8fab-3cf3-43a2-aff8-b6f43e149b0a triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:11:01.902835 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:01.998607 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a8e4c1e7-d58d-4b59-9e17-ea92ee09f9fc req-2c8e0eea-4e42-44f0-a875-55bf5646b62a tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 210 time: 0.1605947
Jun 01 10:11:02.017560 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:02.039288 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 15ce50f0-fa11-464b-a55e-f6f214c49154 {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:11:02.099107 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 15ce50f0-fa11-464b-a55e-f6f214c49154, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=15ce50f0-fa11-464b-a55e-f6f214c49154,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:02.105515 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:02.133115 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c6da8fab-3cf3-43a2-aff8-b6f43e149b0a'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:11:02.135484 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fedda79f-a048-4554-8c69-5c1c22872b68" -d '{"events": [{"server_uuid": "1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa", "name": "network-vif-plugged", "status": "completed", "tag": "c6da8fab-3cf3-43a2-aff8-b6f43e149b0a"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:11:02.142860 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port c6da8fab-3cf3-43a2-aff8-b6f43e149b0a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c6da8fab-3cf3-43a2-aff8-b6f43e149b0a,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:02.162017 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be1e5b6c-b4b2-4e04-9a40-27d8e0395fbf req-47c6a94a-9c2c-4ef4-9cac-e267123c99be tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:02.163526 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-be1e5b6c-b4b2-4e04-9a40-27d8e0395fbf req-47c6a94a-9c2c-4ef4-9cac-e267123c99be tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 944 time: 0.0828872
Jun 01 10:11:02.179112 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:11:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c4a83c98-6850-4057-947c-f72eab510c90 x-openstack-request-id: req-c4a83c98-6850-4057-947c-f72eab510c90 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:11:02.179649 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa", "name": "network-vif-plugged", "status": "completed", "tag": "c6da8fab-3cf3-43a2-aff8-b6f43e149b0a", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:11:02.179920 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-c4a83c98-6850-4057-947c-f72eab510c90 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:11:02.180335 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c6da8fab-3cf3-43a2-aff8-b6f43e149b0a', 'code': 200}
Jun 01 10:11:02.205773 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:02.207944 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-51016dd6-9ce7-4719-8969-8720768c553b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:02.214381 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-be1e5b6c-b4b2-4e04-9a40-27d8e0395fbf req-4adece13-3a03-49c8-aef0-270430706991 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0448763
Jun 01 10:11:02.258338 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:02.294540 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=15ce50f0-fa11-464b-a55e-f6f214c49154,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:02.302788 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:02.303302 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:02.303490 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:02.303820 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:02.304150 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:02.304480 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:02.304813 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:02.305116 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:02.305444 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:02.305753 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:02.306068 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:02.306381 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:02.310119 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:02.310584 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.044s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:02.381886 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=c6da8fab-3cf3-43a2-aff8-b6f43e149b0a,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:02.384865 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:02.474587 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['15ce50f0-fa11-464b-a55e-f6f214c49154'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:11:02.535510 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06029676-a648-418f-a3e2-937c00c7d420 req-d4882065-ca1e-4c35-8263-98db85a91d3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:02.536909 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-06029676-a648-418f-a3e2-937c00c7d420 req-d4882065-ca1e-4c35-8263-98db85a91d3b service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 1099 time: 0.0699961
Jun 01 10:11:02.579302 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-06029676-a648-418f-a3e2-937c00c7d420 req-fa5ad91f-e509-4086-9556-ed89e6aec41f service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0347445
Jun 01 10:11:02.995382 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48374545-a4a3-47b3-be6a-9ae6f0a7e1a8 req-61eb6bee-9705-44c2-a99d-fc6c250dd1a6 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:02.996841 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-48374545-a4a3-47b3-be6a-9ae6f0a7e1a8 req-61eb6bee-9705-44c2-a99d-fc6c250dd1a6 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 946 time: 0.0905643
Jun 01 10:11:03.086614 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-48374545-a4a3-47b3-be6a-9ae6f0a7e1a8 req-409afbcc-c313-421d-a716-8ea0df4ffcd8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0587556
Jun 01 10:11:03.111794 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1956b496-2d17-4d55-bcea-27e34a3a3889 req-60d78b81-d10d-4c78-adb2-de463c7b61e2 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:03.113608 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1956b496-2d17-4d55-bcea-27e34a3a3889 req-60d78b81-d10d-4c78-adb2-de463c7b61e2 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 944 time: 0.2052715
Jun 01 10:11:03.160074 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1956b496-2d17-4d55-bcea-27e34a3a3889 req-659a7503-2f66-4cb5-858c-fae0e8d59847 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0402777
Jun 01 10:11:03.307091 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0cc8ab18-d0b1-4f10-a20c-4e394e7bcc92 req-8636189b-86ab-4f6f-a2c7-8f9907e556e2 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 210 time: 0.1212444
Jun 01 10:11:03.412419 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a070117-7de5-4578-aa26-2d3037746724 req-73334dd0-9d6b-4601-b410-717d39fd62dc tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:03.413869 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9a070117-7de5-4578-aa26-2d3037746724 req-73334dd0-9d6b-4601-b410-717d39fd62dc tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 944 time: 0.0824070
Jun 01 10:11:03.460971 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9a070117-7de5-4578-aa26-2d3037746724 req-65c47c78-af48-4db9-a779-36333fcf99d8 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0410569
Jun 01 10:11:03.701265 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 15ce50f0-fa11-464b-a55e-f6f214c49154 up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:11:03.753767 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-da2c1409-b261-4119-a375-e1a26209b224 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:03.755240 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-da2c1409-b261-4119-a375-e1a26209b224 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.30 "GET /v2.0/networks?id=3a2e5ab1-9bd9-4597-be91-953ea2afbf4b HTTP/1.1" status: 200  len: 813 time: 0.1485846
Jun 01 10:11:03.778405 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Request body: {'port': {'device_id': '72a67d95-dbba-41d6-a26f-15844e8b9415', 'network_id': '3a2e5ab1-9bd9-4597-be91-953ea2afbf4b', 'admin_state_up': True, 'tenant_id': '80c0fea786fd4fb9afd054ddb2559c2a'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:11:03.896672 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port 15ce50f0-fa11-464b-a55e-f6f214c49154 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:11:03.901707 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port 15ce50f0-fa11-464b-a55e-f6f214c49154 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:11:03.902092 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:03.913811 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:11:03.918054 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Usage tracker for resource:port and tenant:80c0fea786fd4fb9afd054ddb2559c2a is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:11:03.921377 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:11:03.926964 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:11:04.016889 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Made reservation on behalf of 80c0fea786fd4fb9afd054ddb2559c2a for: {'port': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:11:04.020558 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:04.027120 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:04.062515 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 15ce50f0-fa11-464b-a55e-f6f214c49154, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=15ce50f0-fa11-464b-a55e-f6f214c49154,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:04.178244 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:04.180448 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:04.188746 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Allocated IP 172.20.0.7 (3a2e5ab1-9bd9-4597-be91-953ea2afbf4b/f256fe0c-ca2a-4bcd-87a4-40fba935858b/c8b555e7-d683-4993-8750-7d3bfbdc6b8b) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:11:04.219969 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0043671-b417-407f-944f-21d4e3af4137', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '15ce50f0-fa11-464b-a55e-f6f214c49154'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:11:04.221356 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5044657f-a50d-460a-a007-a9a830e23300" -d '{"events": [{"server_uuid": "e0043671-b417-407f-944f-21d4e3af4137", "name": "network-vif-plugged", "status": "completed", "tag": "15ce50f0-fa11-464b-a55e-f6f214c49154"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:11:04.262405 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=15ce50f0-fa11-464b-a55e-f6f214c49154,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:04.265476 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:04.460741 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d51fd5a-c9d4-43e9-aa1a-bf4e8da4cdce req-bd7030c0-ae3d-4e19-8a32-84ccf7e7f4f3 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:04.462204 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2d51fd5a-c9d4-43e9-aa1a-bf4e8da4cdce req-bd7030c0-ae3d-4e19-8a32-84ccf7e7f4f3 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 946 time: 0.2630892
Jun 01 10:11:04.548324 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dce7c8cd-87cf-4f9d-a437-0ac2ded048fb req-8c4755d8-1260-4a00-b412-5905e142bf33 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:04.549677 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dce7c8cd-87cf-4f9d-a437-0ac2ded048fb req-8c4755d8-1260-4a00-b412-5905e142bf33 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.2577531
Jun 01 10:11:04.561586 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2d51fd5a-c9d4-43e9-aa1a-bf4e8da4cdce req-dc18d070-0c6e-4f94-b56f-9edf74e0e3fb tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0904582
Jun 01 10:11:04.595181 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:04.612941 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:11:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-56bfbb9c-39c6-41b0-8d5d-c71a89222661 x-openstack-request-id: req-56bfbb9c-39c6-41b0-8d5d-c71a89222661 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:11:04.614391 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e0043671-b417-407f-944f-21d4e3af4137", "name": "network-vif-plugged", "status": "completed", "tag": "15ce50f0-fa11-464b-a55e-f6f214c49154", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:11:04.616793 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-56bfbb9c-39c6-41b0-8d5d-c71a89222661 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:11:04.617651 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e0043671-b417-407f-944f-21d4e3af4137', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '15ce50f0-fa11-464b-a55e-f6f214c49154', 'code': 200}
Jun 01 10:11:04.624888 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dce7c8cd-87cf-4f9d-a437-0ac2ded048fb req-65210e2a-da41-42db-85b6-7bb147b22a54 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0685551
Jun 01 10:11:04.707716 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:04.716497 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:04.870437 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Network 3a2e5ab1-9bd9-4597-be91-953ea2afbf4b is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:11:04.876763 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:11:04.886952 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:11:04.920562 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Pushing event updated for resources: {'Port': ['ID=c8b555e7-d683-4993-8750-7d3bfbdc6b8b,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:04.929485 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:04.983799 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:04.984411 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:05.003869 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9e132df-b5ff-49c2-93b5-ddc48ce04f5c req-a2ddfd5e-713d-40ba-955b-4af448b7aed8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:05.005344 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-c9e132df-b5ff-49c2-93b5-ddc48ce04f5c req-a2ddfd5e-713d-40ba-955b-4af448b7aed8 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 1098 time: 0.0777533
Jun 01 10:11:05.016780 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73f8108d-c324-4306-bdab-cff3ff80759e req-83feec82-902b-47f4-aa2c-97d7d1d9ec33 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:05.018248 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-73f8108d-c324-4306-bdab-cff3ff80759e req-83feec82-902b-47f4-aa2c-97d7d1d9ec33 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 931 time: 0.3026752
Jun 01 10:11:05.029072 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b01c7fb2-5b2e-4456-8a8b-55e1ad83de9a req-0ca5368f-9126-4a53-850e-571966f146c3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:05.030944 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b01c7fb2-5b2e-4456-8a8b-55e1ad83de9a req-0ca5368f-9126-4a53-850e-571966f146c3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 944 time: 0.2370327
Jun 01 10:11:05.050300 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-c9e132df-b5ff-49c2-93b5-ddc48ce04f5c req-6bc38782-83ff-445a-840b-c91573065c89 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0364244
Jun 01 10:11:05.099402 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-73f8108d-c324-4306-bdab-cff3ff80759e req-e0d052bb-5c60-4018-a89e-375b9e8d5c47 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0676177
Jun 01 10:11:05.106245 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b01c7fb2-5b2e-4456-8a8b-55e1ad83de9a req-b6f2b7c9-eaa1-4de3-9933-54b222039829 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0590599
Jun 01 10:11:05.108071 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.3336675
Jun 01 10:11:05.130353 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Request body: {'port': {'device_id': '72a67d95-dbba-41d6-a26f-15844e8b9415', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:11:05.243708 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:05.659351 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c8b555e7-d683-4993-8750-7d3bfbdc6b8b {{(pid=92566) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:11:05.666252 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:05.680812 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Transition to ACTIVE for port object c8b555e7-d683-4993-8750-7d3bfbdc6b8b will not be triggered until provisioned by entity L2. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:11:05.799692 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:05.808677 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b9ab98f2-2158-42d9-b737-920775ebf403 tempest-ServerRescueNegativeTestJSON-528516606 tempest-ServerRescueNegativeTestJSON-528516606-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:05.976424 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Pushing event updated for resources: {'Port': ['ID=c8b555e7-d683-4993-8750-7d3bfbdc6b8b,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:05.985491 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:06.052152 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ff798e8-497c-44f5-9c4d-1e6bd173d4b4 req-a002d6f1-42b8-4808-9697-c0ad456d9e17 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:06.053646 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3ff798e8-497c-44f5-9c4d-1e6bd173d4b4 req-a002d6f1-42b8-4808-9697-c0ad456d9e17 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.2932777
Jun 01 10:11:06.104554 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Attempting to bind port c8b555e7-d683-4993-8750-7d3bfbdc6b8b on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:11:06.104888 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Attempting to bind port c8b555e7-d683-4993-8750-7d3bfbdc6b8b by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': 'f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '3a2e5ab1-9bd9-4597-be91-953ea2afbf4b'}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:11:06.105235 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Attempting to bind port c8b555e7-d683-4993-8750-7d3bfbdc6b8b on network 3a2e5ab1-9bd9-4597-be91-953ea2afbf4b {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:11:06.114142 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Port c8b555e7-d683-4993-8750-7d3bfbdc6b8b on network 3a2e5ab1-9bd9-4597-be91-953ea2afbf4b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:11:06.114461 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Attempting to bind port c8b555e7-d683-4993-8750-7d3bfbdc6b8b on network 3a2e5ab1-9bd9-4597-be91-953ea2afbf4b {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:11:06.124446 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3ff798e8-497c-44f5-9c4d-1e6bd173d4b4 req-c059fd40-70b2-4c38-9e9c-8bd44025f330 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0631683
Jun 01 10:11:06.131753 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 10, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:11:06.131753 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Checking segment: {'id': 'f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '3a2e5ab1-9bd9-4597-be91-953ea2afbf4b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:11:06.131753 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Bound using segment: {'id': 'f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '3a2e5ab1-9bd9-4597-be91-953ea2afbf4b'} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:11:06.131753 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Bound port: c8b555e7-d683-4993-8750-7d3bfbdc6b8b, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '3a2e5ab1-9bd9-4597-be91-953ea2afbf4b'}}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:11:06.131753 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:06.272460 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] For port c8b555e7-d683-4993-8750-7d3bfbdc6b8b, host hv-cinder-78726, cleared binding levels {{(pid=92566) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:11:06.328437 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] For port c8b555e7-d683-4993-8750-7d3bfbdc6b8b, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c8b555e7-d683-4993-8750-7d3bfbdc6b8b,segment=NetworkSegment(f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793),segment_id=f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793)] {{(pid=92566) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:11:06.387317 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eb1687f-554d-47e1-8865-3c6e4d6c407b req-fd32094e-0b94-4fd7-8b71-d81ea7b8f5c0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:06.388792 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1eb1687f-554d-47e1-8865-3c6e4d6c407b req-fd32094e-0b94-4fd7-8b71-d81ea7b8f5c0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 944 time: 0.1147189
Jun 01 10:11:06.397008 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e50f73ba-1176-4ee2-ae74-9dd3dd2a4947 req-bddd28c7-3f95-417a-b009-26587abaa474 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:06.397837 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-e50f73ba-1176-4ee2-ae74-9dd3dd2a4947 req-bddd28c7-3f95-417a-b009-26587abaa474 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Synchronizing usage tracker for tenant:80c0fea786fd4fb9afd054ddb2559c2a on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:11:06.448280 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:06.453222 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-676d271f-4922-482d-8c92-14bf1bed7b0f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:06.483529 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1eb1687f-554d-47e1-8865-3c6e4d6c407b req-dcd265cf-ac2e-4e08-ac22-c1baff1e5544 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0826883
Jun 01 10:11:06.514206 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:06.514206 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:06.514206 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] 10.222.0.30 "PUT /v2.0/ports/c8b555e7-d683-4993-8750-7d3bfbdc6b8b HTTP/1.1" status: 200  len: 1093 time: 1.3860404
Jun 01 10:11:06.516465 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '72a67d95-dbba-41d6-a26f-15844e8b9415', 'tag': 'c8b555e7-d683-4993-8750-7d3bfbdc6b8b'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:11:06.519662 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1392461d-3b1a-4b4d-8502-a7583a5c2015" -d '{"events": [{"name": "network-changed", "server_uuid": "72a67d95-dbba-41d6-a26f-15844e8b9415", "tag": "c8b555e7-d683-4993-8750-7d3bfbdc6b8b"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:11:06.524686 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-e50f73ba-1176-4ee2-ae74-9dd3dd2a4947 req-bddd28c7-3f95-417a-b009-26587abaa474 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Unset dirty status for tenant:80c0fea786fd4fb9afd054ddb2559c2a on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:11:06.525830 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e50f73ba-1176-4ee2-ae74-9dd3dd2a4947 req-bddd28c7-3f95-417a-b009-26587abaa474 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 943 time: 0.2970676
Jun 01 10:11:06.561564 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Pushing event updated for resources: {'Port': ['ID=c8b555e7-d683-4993-8750-7d3bfbdc6b8b,revision_number=3']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:06.565473 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:06.595006 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e50f73ba-1176-4ee2-ae74-9dd3dd2a4947 req-0096aac3-4152-47d9-b399-c315ea33d1b1 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0619488
Jun 01 10:11:06.659032 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:11:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-73c0f6c1-c35a-42f2-a213-16a4cce7e93b x-openstack-request-id: req-73c0f6c1-c35a-42f2-a213-16a4cce7e93b {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:11:06.659348 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "72a67d95-dbba-41d6-a26f-15844e8b9415", "tag": "c8b555e7-d683-4993-8750-7d3bfbdc6b8b", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:11:06.659622 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-73c0f6c1-c35a-42f2-a213-16a4cce7e93b {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:11:06.660027 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '72a67d95-dbba-41d6-a26f-15844e8b9415', 'tag': 'c8b555e7-d683-4993-8750-7d3bfbdc6b8b', 'status': 'completed', 'code': 200}
Jun 01 10:11:06.700028 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-27e77ae2-890a-4398-a53f-60cdabdcb407 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:06.701513 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-27e77ae2-890a-4398-a53f-60cdabdcb407 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=80c0fea786fd4fb9afd054ddb2559c2a&device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 1096 time: 0.0840828
Jun 01 10:11:06.772641 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-8759ff61-0037-4557-ac89-df95a00ec36b service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c8b555e7-d683-4993-8750-7d3bfbdc6b8b HTTP/1.1" status: 200  len: 217 time: 0.0635529
Jun 01 10:11:06.839117 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-89000830-f22a-4572-861d-9d13b14033de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:06.840464 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-89000830-f22a-4572-861d-9d13b14033de service neutron] 10.222.0.30 "GET /v2.0/subnets?id=f256fe0c-ca2a-4bcd-87a4-40fba935858b HTTP/1.1" status: 200  len: 853 time: 0.0603154
Jun 01 10:11:06.889828 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-35cdc0c3-b479-49f3-a0af-540e08f98e6c service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=3a2e5ab1-9bd9-4597-be91-953ea2afbf4b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0423551
Jun 01 10:11:07.026099 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-b2d5b3dd-1641-4d19-8359-767588b2500f service neutron] 10.222.0.30 "GET /v2.0/networks/3a2e5ab1-9bd9-4597-be91-953ea2afbf4b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1248450
Jun 01 10:11:07.158243 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47ac02f1-6c15-4346-9aa0-4d6b83862489 req-e3e626d6-5ef9-4c18-9ff7-e26c44c8a3ed service neutron] 10.222.0.30 "GET /v2.0/networks/3a2e5ab1-9bd9-4597-be91-953ea2afbf4b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1244292
Jun 01 10:11:07.377648 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab962087-b0b8-490e-8a72-f7787dacb9f1 req-ba411c63-4f8c-425f-9677-20e68fabc715 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:07.379176 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ab962087-b0b8-490e-8a72-f7787dacb9f1 req-ba411c63-4f8c-425f-9677-20e68fabc715 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.1378217
Jun 01 10:11:07.400081 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1392461d-3b1a-4b4d-8502-a7583a5c2015 req-4b23c5b4-c62c-469f-864b-eb2e7586fe00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:07.401500 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1392461d-3b1a-4b4d-8502-a7583a5c2015 req-4b23c5b4-c62c-469f-864b-eb2e7586fe00 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=80c0fea786fd4fb9afd054ddb2559c2a&device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 1096 time: 0.1156931
Jun 01 10:11:07.578212 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ab962087-b0b8-490e-8a72-f7787dacb9f1 req-d3018d13-c6a5-4257-ba47-ef990265fe4a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1932564
Jun 01 10:11:07.682366 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1392461d-3b1a-4b4d-8502-a7583a5c2015 req-c63a405b-d84e-4ec3-a063-5e1094123615 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:07.683851 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1392461d-3b1a-4b4d-8502-a7583a5c2015 req-c63a405b-d84e-4ec3-a063-5e1094123615 service neutron] 10.222.0.30 "GET /v2.0/networks?id=3a2e5ab1-9bd9-4597-be91-953ea2afbf4b HTTP/1.1" status: 200  len: 914 time: 0.2746267
Jun 01 10:11:07.733102 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 435c6b97-3648-4e27-92c7-12447506ef9f details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:11:07.794995 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1392461d-3b1a-4b4d-8502-a7583a5c2015 req-8326dfac-7935-4992-8194-ac51805f2c46 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c8b555e7-d683-4993-8750-7d3bfbdc6b8b HTTP/1.1" status: 200  len: 217 time: 0.1022072
Jun 01 10:11:07.864307 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f48f8dd3-692e-486f-af49-4cf699d1e5dd req-9835cb3e-21e3-45f7-961d-7df380efc7db tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:07.868384 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f48f8dd3-692e-486f-af49-4cf699d1e5dd req-9835cb3e-21e3-45f7-961d-7df380efc7db tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 944 time: 0.2563825
Jun 01 10:11:07.868566 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 435c6b97-3648-4e27-92c7-12447506ef9f, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=435c6b97-3648-4e27-92c7-12447506ef9f,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:07.884378 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': '435c6b97-3648-4e27-92c7-12447506ef9f', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'port_id': '435c6b97-3648-4e27-92c7-12447506ef9f', 'mac_address': 'fa:16:3e:d3:ed:ea', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 857, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:11:07.919717 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1392461d-3b1a-4b4d-8502-a7583a5c2015 req-657ce796-fba8-4179-9ac3-f8c18ef9753e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:07.921078 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1392461d-3b1a-4b4d-8502-a7583a5c2015 req-657ce796-fba8-4179-9ac3-f8c18ef9753e service neutron] 10.222.0.30 "GET /v2.0/subnets?id=f256fe0c-ca2a-4bcd-87a4-40fba935858b HTTP/1.1" status: 200  len: 853 time: 0.1121933
Jun 01 10:11:07.948693 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:07.957332 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 435c6b97-3648-4e27-92c7-12447506ef9f {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:11:07.968973 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03840b31-123d-414e-a8cb-5db2e5ad31d2 req-969e7f2c-c5cd-45f4-8e59-acd515106cdf tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:07.970433 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-03840b31-123d-414e-a8cb-5db2e5ad31d2 req-969e7f2c-c5cd-45f4-8e59-acd515106cdf tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.2803869
Jun 01 10:11:07.983357 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 435c6b97-3648-4e27-92c7-12447506ef9f, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=435c6b97-3648-4e27-92c7-12447506ef9f,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:07.983526 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f48f8dd3-692e-486f-af49-4cf699d1e5dd req-f61c21e3-67f1-4e17-84a9-50e9cfdbd351 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1027954
Jun 01 10:11:07.983660 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 35506) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:11:07.984844 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1392461d-3b1a-4b4d-8502-a7583a5c2015 req-b4cba5bf-aee9-4262-9c14-93683b6b904d service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=3a2e5ab1-9bd9-4597-be91-953ea2afbf4b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0549839
Jun 01 10:11:07.985366 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-35940a5f-5a3f-4918-a4a2-2c0010149994 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Request body: {'floatingip': {'port_id': '15ce50f0-fa11-464b-a55e-f6f214c49154'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:11:08.055902 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:08.058267 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-51016dd6-9ce7-4719-8969-8720768c553b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:08.078711 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-35940a5f-5a3f-4918-a4a2-2c0010149994 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for floatingip, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:08.135074 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=435c6b97-3648-4e27-92c7-12447506ef9f,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:08.144767 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:08.183683 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1392461d-3b1a-4b4d-8502-a7583a5c2015 req-3dfec1e8-7544-4cb7-97a6-b5ad187cb1e6 service neutron] 10.222.0.30 "GET /v2.0/networks/3a2e5ab1-9bd9-4597-be91-953ea2afbf4b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1912103
Jun 01 10:11:08.224435 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17a5ff43-5fb7-42aa-85ae-d4ca82fac14b req-adba25f2-e1a9-4d3e-ab8f-edb5060aeecf tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:08.225788 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-17a5ff43-5fb7-42aa-85ae-d4ca82fac14b req-adba25f2-e1a9-4d3e-ab8f-edb5060aeecf tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 943 time: 0.1509662
Jun 01 10:11:08.345287 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-17a5ff43-5fb7-42aa-85ae-d4ca82fac14b req-a8e22ba1-2548-4684-bc14-5351b38cbb23 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0737247
Jun 01 10:11:08.353152 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['435c6b97-3648-4e27-92c7-12447506ef9f'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:11:08.367600 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1392461d-3b1a-4b4d-8502-a7583a5c2015 req-4d4b4c18-5d74-4c3f-a539-68f16e36598b service neutron] 10.222.0.30 "GET /v2.0/networks/3a2e5ab1-9bd9-4597-be91-953ea2afbf4b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1753719
Jun 01 10:11:08.765827 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-35940a5f-5a3f-4918-a4a2-2c0010149994 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:08.833809 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-35940a5f-5a3f-4918-a4a2-2c0010149994 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:09.022145 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.l3_db [None req-35940a5f-5a3f-4918-a4a2-2c0010149994 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Floating IP ce6e5c86-9a91-4cb6-b81e-e0abdda4ee16 associated. External IP: 172.27.2.136, port: 15ce50f0-fa11-464b-a55e-f6f214c49154.
Jun 01 10:11:09.165316 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd9b1f98-476a-4f36-a9f4-b66a0709e98c req-09749187-03a3-4990-8e19-52cfe711f1a2 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:09.166772 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dd9b1f98-476a-4f36-a9f4-b66a0709e98c req-09749187-03a3-4990-8e19-52cfe711f1a2 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 945 time: 0.0795844
Jun 01 10:11:09.211965 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dd9b1f98-476a-4f36-a9f4-b66a0709e98c req-dddc0ce8-fd5c-4e78-883c-ea5c8961e754 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0389414
Jun 01 10:11:09.376394 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-35940a5f-5a3f-4918-a4a2-2c0010149994 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Router d65374d4-451b-4890-a2f5-a4bcac5a9a38 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:11:09.534860 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34615beb-c593-46f8-9083-fbc517d5477a req-a9e24dad-c2fd-4741-88e1-3603ebc683ee tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:09.536354 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34615beb-c593-46f8-9083-fbc517d5477a req-a9e24dad-c2fd-4741-88e1-3603ebc683ee tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 943 time: 0.0840967
Jun 01 10:11:09.556834 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-35940a5f-5a3f-4918-a4a2-2c0010149994 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:11:09.561725 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-35940a5f-5a3f-4918-a4a2-2c0010149994 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:09.568846 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7dfe86cd-7837-4601-b71d-b4f665a9382e None None] Sync routers for ids ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:11:09.583953 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-34615beb-c593-46f8-9083-fbc517d5477a req-48e16654-b9cd-4aa0-8e6c-b99c5ca08759 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419693
Jun 01 10:11:09.590864 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7dfe86cd-7837-4601-b71d-b4f665a9382e None None] Routers {'d65374d4-451b-4890-a2f5-a4bcac5a9a38'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:11:09.591538 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-7dfe86cd-7837-4601-b71d-b4f665a9382e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7283f310>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:10:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:11:09.623007 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-35940a5f-5a3f-4918-a4a2-2c0010149994 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "PUT /v2.0/floatingips/ce6e5c86-9a91-4cb6-b81e-e0abdda4ee16 HTTP/1.1" status: 200  len: 991 time: 1.6400199
Jun 01 10:11:09.623007 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e0043671-b417-407f-944f-21d4e3af4137', 'tag': '15ce50f0-fa11-464b-a55e-f6f214c49154'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:11:09.623468 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-92d7ac47-e737-4c05-9d32-a664e0ebeeda" -d '{"events": [{"name": "network-changed", "server_uuid": "e0043671-b417-407f-944f-21d4e3af4137", "tag": "15ce50f0-fa11-464b-a55e-f6f214c49154"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:11:09.679247 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:11:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-881f0099-b33f-4695-af21-32d34079ad79 x-openstack-request-id: req-881f0099-b33f-4695-af21-32d34079ad79 {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:11:09.679247 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e0043671-b417-407f-944f-21d4e3af4137", "tag": "15ce50f0-fa11-464b-a55e-f6f214c49154", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:11:09.679523 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-881f0099-b33f-4695-af21-32d34079ad79 {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:11:09.679768 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e0043671-b417-407f-944f-21d4e3af4137', 'tag': '15ce50f0-fa11-464b-a55e-f6f214c49154', 'status': 'completed', 'code': 200}
Jun 01 10:11:09.754797 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device c8b555e7-d683-4993-8750-7d3bfbdc6b8b details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:11:09.757298 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 435c6b97-3648-4e27-92c7-12447506ef9f up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:11:09.783917 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92d7ac47-e737-4c05-9d32-a664e0ebeeda req-46df64a7-9239-451b-9238-609c5a295f32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:09.785396 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-92d7ac47-e737-4c05-9d32-a664e0ebeeda req-46df64a7-9239-451b-9238-609c5a295f32 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=f4f6f875519045a39c1fdbadd53ce517&device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 1098 time: 0.0731852
Jun 01 10:11:09.919508 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92d7ac47-e737-4c05-9d32-a664e0ebeeda req-38d625c8-4a6b-410f-899f-26d75efadc87 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:09.920908 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-92d7ac47-e737-4c05-9d32-a664e0ebeeda req-38d625c8-4a6b-410f-899f-26d75efadc87 service neutron] 10.222.0.30 "GET /v2.0/networks?id=be546533-cf92-483d-9e38-7d14ca9c4902 HTTP/1.1" status: 200  len: 917 time: 0.1278894
Jun 01 10:11:09.924274 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-7dfe86cd-7837-4601-b71d-b4f665a9382e None None] Set router d65374d4-451b-4890-a2f5-a4bcac5a9a38 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:11:10.026371 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-92d7ac47-e737-4c05-9d32-a664e0ebeeda req-d4b9ba6a-afd8-47e2-868b-10698f7a824d service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=15ce50f0-fa11-464b-a55e-f6f214c49154 HTTP/1.1" status: 200  len: 999 time: 0.0986023
Jun 01 10:11:10.094016 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92d7ac47-e737-4c05-9d32-a664e0ebeeda req-4ee24c1e-e969-4355-818b-a3fd2b703f37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:10.095570 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-92d7ac47-e737-4c05-9d32-a664e0ebeeda req-4ee24c1e-e969-4355-818b-a3fd2b703f37 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=f2fdda64-a03c-41d7-8178-daca0363bd6e HTTP/1.1" status: 200  len: 855 time: 0.0622964
Jun 01 10:11:10.108689 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port 435c6b97-3648-4e27-92c7-12447506ef9f completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:11:10.128916 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port 435c6b97-3648-4e27-92c7-12447506ef9f triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:11:10.129295 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:10.171319 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92d7ac47-e737-4c05-9d32-a664e0ebeeda req-8f08ad35-7f42-4034-8aaa-c64555ea9c2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:10.172733 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-92d7ac47-e737-4c05-9d32-a664e0ebeeda req-8f08ad35-7f42-4034-8aaa-c64555ea9c2f service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=be546533-cf92-483d-9e38-7d14ca9c4902&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0705171
Jun 01 10:11:10.179211 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port c8b555e7-d683-4993-8750-7d3bfbdc6b8b, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c8b555e7-d683-4993-8750-7d3bfbdc6b8b,segment=NetworkSegment(f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793),segment_id=f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:10.207491 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': 'c8b555e7-d683-4993-8750-7d3bfbdc6b8b', 'network_id': '3a2e5ab1-9bd9-4597-be91-953ea2afbf4b', 'port_id': 'c8b555e7-d683-4993-8750-7d3bfbdc6b8b', 'mac_address': 'fa:16:3e:63:d1:e6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 898, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f256fe0c-ca2a-4bcd-87a4-40fba935858b', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:11:10.390467 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:10.444527 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c8b555e7-d683-4993-8750-7d3bfbdc6b8b {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:11:10.447663 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-92d7ac47-e737-4c05-9d32-a664e0ebeeda req-412d38ff-7d9e-4458-83e2-422ecf26de3d service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2647867
Jun 01 10:11:10.460124 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:10.483861 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c7d2b4e-e77c-4401-8057-baaa8b53c0c2 req-9c01acef-bcdf-48b2-9d1a-edfad0678acf tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:10.485320 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2c7d2b4e-e77c-4401-8057-baaa8b53c0c2 req-9c01acef-bcdf-48b2-9d1a-edfad0678acf tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 945 time: 0.1499207
Jun 01 10:11:10.533516 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port c8b555e7-d683-4993-8750-7d3bfbdc6b8b, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c8b555e7-d683-4993-8750-7d3bfbdc6b8b,segment=NetworkSegment(f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793),segment_id=f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:10.538443 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-5e724a11-93a7-4ea2-ba3f-97e792856ef9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:10.544668 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4a01bc46-d5a0-4ef7-9aff-f160ee9d943f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '435c6b97-3648-4e27-92c7-12447506ef9f'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:11:10.547506 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c2add2f6-e088-428d-8bb3-889507a26ff9" -d '{"events": [{"server_uuid": "4a01bc46-d5a0-4ef7-9aff-f160ee9d943f", "name": "network-vif-plugged", "status": "completed", "tag": "435c6b97-3648-4e27-92c7-12447506ef9f"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:11:10.575028 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 435c6b97-3648-4e27-92c7-12447506ef9f, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=435c6b97-3648-4e27-92c7-12447506ef9f,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:10.597341 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-7dfe86cd-7837-4601-b71d-b4f665a9382e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7283f310>, [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:18Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': 'ce6e5c86-9a91-4cb6-b81e-e0abdda4ee16', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'floating_ip_address': '172.27.2.136', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'port_id': '15ce50f0-fa11-464b-a55e-f6f214c49154', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 427, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'mac_address': 'fa:16:3e:9f:c6:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e0043671-b417-407f-944f-21d4e3af4137', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:10:45Z', 'updated_at': '2021-06-01T10:11:08Z', 'revision_number': 1, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '476d2473-d40f-4cca-8a85-8b1ea30a5281', 'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'mac_address': 'fa:16:3e:87:a6:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:15Z', 'updated_at': '2021-06-01T10:06:36Z', 'revision_number': 5, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'subnets': [{'id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:11:10.599193 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:11:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-54ca8ce1-f47d-497e-a308-b230602a0e52 x-openstack-request-id: req-54ca8ce1-f47d-497e-a308-b230602a0e52 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:11:10.599524 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4a01bc46-d5a0-4ef7-9aff-f160ee9d943f", "name": "network-vif-plugged", "status": "completed", "tag": "435c6b97-3648-4e27-92c7-12447506ef9f", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:11:10.599785 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-54ca8ce1-f47d-497e-a308-b230602a0e52 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:11:10.600523 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4a01bc46-d5a0-4ef7-9aff-f160ee9d943f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '435c6b97-3648-4e27-92c7-12447506ef9f', 'code': 200}
Jun 01 10:11:10.600975 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:10.604015 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:10.607775 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2c7d2b4e-e77c-4401-8057-baaa8b53c0c2 req-3ce09a85-4bcd-4739-a937-25ba66664a76 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0713360
Jun 01 10:11:10.634623 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-92d7ac47-e737-4c05-9d32-a664e0ebeeda req-d040ec91-5ba5-4fc1-abc7-18e381093ac9 service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1795287
Jun 01 10:11:10.666003 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:10.667969 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7dfe86cd-7837-4601-b71d-b4f665a9382e None None] Checking router: d65374d4-451b-4890-a2f5-a4bcac5a9a38 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:11:10.686034 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7dfe86cd-7837-4601-b71d-b4f665a9382e None None] Routers {'d65374d4-451b-4890-a2f5-a4bcac5a9a38'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:11:10.687250 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-7dfe86cd-7837-4601-b71d-b4f665a9382e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7283f310>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:10:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:11:10.769088 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=c8b555e7-d683-4993-8750-7d3bfbdc6b8b,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:10.774785 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:10.775433 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.103s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:10.831528 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7333323-d62c-449b-9815-491d12991485 req-53015f7e-2914-4632-bbc2-a7485d0a6d2a tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:10.833203 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d7333323-d62c-449b-9815-491d12991485 req-53015f7e-2914-4632-bbc2-a7485d0a6d2a tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 944 time: 0.1158662
Jun 01 10:11:10.880353 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d7333323-d62c-449b-9815-491d12991485 req-e1b4d685-0be3-4b1f-bc10-bdd6701f1db3 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0412118
Jun 01 10:11:10.947212 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['c8b555e7-d683-4993-8750-7d3bfbdc6b8b'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:11:10.983999 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=435c6b97-3648-4e27-92c7-12447506ef9f,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:10.987102 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:11.013071 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-7dfe86cd-7837-4601-b71d-b4f665a9382e None None] Set router d65374d4-451b-4890-a2f5-a4bcac5a9a38 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:11:11.142609 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a65e2c04-acbf-4ee6-bc54-c6f25a446c00 req-d10cccc9-21bf-490e-9d82-1b52ed53f45b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:11.144158 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a65e2c04-acbf-4ee6-bc54-c6f25a446c00 req-d10cccc9-21bf-490e-9d82-1b52ed53f45b service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 1099 time: 0.0716615
Jun 01 10:11:11.191959 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a65e2c04-acbf-4ee6-bc54-c6f25a446c00 req-6c71e04b-9508-41e2-9b4f-c3a55dbaedfa service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0396695
Jun 01 10:11:11.516281 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-7dfe86cd-7837-4601-b71d-b4f665a9382e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7283f310>, [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:18Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': 'ce6e5c86-9a91-4cb6-b81e-e0abdda4ee16', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'floating_ip_address': '172.27.2.136', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'port_id': '15ce50f0-fa11-464b-a55e-f6f214c49154', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 427, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'mac_address': 'fa:16:3e:9f:c6:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e0043671-b417-407f-944f-21d4e3af4137', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:10:45Z', 'updated_at': '2021-06-01T10:11:08Z', 'revision_number': 1, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '476d2473-d40f-4cca-8a85-8b1ea30a5281', 'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'mac_address': 'fa:16:3e:87:a6:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:15Z', 'updated_at': '2021-06-01T10:06:36Z', 'revision_number': 5, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'subnets': [{'id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:11:11.520180 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7dfe86cd-7837-4601-b71d-b4f665a9382e None None] The sync data for ids ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'] in dv-cinder-787262-4-iscsi is: [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:18Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': 'ce6e5c86-9a91-4cb6-b81e-e0abdda4ee16', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'floating_ip_address': '172.27.2.136', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'port_id': '15ce50f0-fa11-464b-a55e-f6f214c49154', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 427, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'mac_address': 'fa:16:3e:9f:c6:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e0043671-b417-407f-944f-21d4e3af4137', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:10:45Z', 'updated_at': '2021-06-01T10:11:08Z', 'revision_number': 1, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '476d2473-d40f-4cca-8a85-8b1ea30a5281', 'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'mac_address': 'fa:16:3e:87:a6:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:15Z', 'updated_at': '2021-06-01T10:06:36Z', 'revision_number': 5, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'subnets': [{'id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:11:11.707804 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e8214c1-bebf-4328-8b25-b56210d035f1 None None] New status for floating IP ce6e5c86-9a91-4cb6-b81e-e0abdda4ee16: ACTIVE {{(pid=92568) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:11:11.807221 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9deecd-039c-42a7-bc58-f92fb17af412 req-1071348b-9d5b-4cbb-b41f-db731909a426 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:11.808689 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0a9deecd-039c-42a7-bc58-f92fb17af412 req-1071348b-9d5b-4cbb-b41f-db731909a426 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 946 time: 0.0846012
Jun 01 10:11:11.855213 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0a9deecd-039c-42a7-bc58-f92fb17af412 req-73a916ae-76e8-40f3-af0f-fd8547058e0a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0407348
Jun 01 10:11:12.075373 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d5c2f9b-2d78-422a-8e94-6cea14e2935d req-45e0c8d5-3c57-419f-8c81-6fa5726f81b1 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:12.076860 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0d5c2f9b-2d78-422a-8e94-6cea14e2935d req-45e0c8d5-3c57-419f-8c81-6fa5726f81b1 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 944 time: 0.0848064
Jun 01 10:11:12.124643 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0d5c2f9b-2d78-422a-8e94-6cea14e2935d req-dee0e8cd-259f-4696-8fbe-933ce489ceed tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411487
Jun 01 10:11:12.471154 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:11:12.943062 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-fa9705c3-d4b8-4fb4-ba6a-026324253689 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:13.051147 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8875658-d683-4e2c-b12c-b31b8ea397aa req-81e8bc6d-86c0-4a72-a25c-7903028173c6 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:13.052617 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c8875658-d683-4e2c-b12c-b31b8ea397aa req-81e8bc6d-86c0-4a72-a25c-7903028173c6 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 946 time: 0.0926137
Jun 01 10:11:13.097168 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c8875658-d683-4e2c-b12c-b31b8ea397aa req-5f572587-baab-40a1-8deb-b22e4dfd58c8 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0388508
Jun 01 10:11:13.239940 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:13.281482 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aa4d928-54cd-4bdf-9dca-0b41200297a8 req-988c71cc-9b46-448c-ab87-c104cad5a82b tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:13.283011 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9aa4d928-54cd-4bdf-9dca-0b41200297a8 req-988c71cc-9b46-448c-ab87-c104cad5a82b tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0843890
Jun 01 10:11:13.379704 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9aa4d928-54cd-4bdf-9dca-0b41200297a8 req-b5677249-581b-4e9f-9608-67a6b723edd8 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0905263
Jun 01 10:11:13.407627 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec47dddd-7270-407f-81c7-3fd214577f94 req-91eeb2bd-0aff-4458-bd3c-3ae292ddb578 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:13.409091 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ec47dddd-7270-407f-81c7-3fd214577f94 req-91eeb2bd-0aff-4458-bd3c-3ae292ddb578 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 946 time: 0.1014977
Jun 01 10:11:13.453204 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ec47dddd-7270-407f-81c7-3fd214577f94 req-e1394180-0670-41a8-8f23-302e1a9a33db tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385566
Jun 01 10:11:13.476438 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 35560) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:11:13.553542 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8372b8-f80e-4b00-9445-064935d40dfa req-e5a54a8f-eca0-4d6c-bff6-d29ef37b6b1a tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:13.554889 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8b8372b8-f80e-4b00-9445-064935d40dfa req-e5a54a8f-eca0-4d6c-bff6-d29ef37b6b1a tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 944 time: 0.0821879
Jun 01 10:11:13.594791 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b25111f4-c190-44eb-af9c-246aa633cfb5 tempest-TestVolumeBootPattern-1204700571 tempest-TestVolumeBootPattern-1204700571-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:13.595545 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-b25111f4-c190-44eb-af9c-246aa633cfb5 tempest-TestVolumeBootPattern-1204700571 tempest-TestVolumeBootPattern-1204700571-project-admin] Synchronizing usage tracker for tenant:1357a99c386544928f00bd66b4f5a21b on resource:port {{(pid=92565) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:11:13.600252 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8b8372b8-f80e-4b00-9445-064935d40dfa req-c4d1c766-7d9e-460e-824f-eec216a8e199 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397048
Jun 01 10:11:13.679744 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-b25111f4-c190-44eb-af9c-246aa633cfb5 tempest-TestVolumeBootPattern-1204700571 tempest-TestVolumeBootPattern-1204700571-project-admin] Unset dirty status for tenant:1357a99c386544928f00bd66b4f5a21b on resource:port {{(pid=92565) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:11:13.680939 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-b25111f4-c190-44eb-af9c-246aa633cfb5 tempest-TestVolumeBootPattern-1204700571 tempest-TestVolumeBootPattern-1204700571-project-admin] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 1094 time: 0.2035346
Jun 01 10:11:13.683923 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 35566) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:11:13.689666 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Request body: {'floatingip': {'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'port_id': '435c6b97-3648-4e27-92c7-12447506ef9f', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address': '172.20.0.13'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:11:13.695656 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:11:13.699402 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Usage tracker for resource:floatingip and tenant:cfa9132b1ba044548228b96f6c2755eb is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:11:13.702807 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:11:13.708472 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:11:13.781098 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device c8b555e7-d683-4993-8750-7d3bfbdc6b8b up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:11:13.800013 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for floatingip, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:13.931122 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port c8b555e7-d683-4993-8750-7d3bfbdc6b8b completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:11:13.936176 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port c8b555e7-d683-4993-8750-7d3bfbdc6b8b triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:11:13.937268 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:13.941511 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:14.076195 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:14.082380 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Allocated IP 172.27.2.247 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/dd7d47ff-2d30-4183-8be4-fa4d48638753) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:11:14.106376 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '72a67d95-dbba-41d6-a26f-15844e8b9415', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c8b555e7-d683-4993-8750-7d3bfbdc6b8b'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:11:14.108729 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b728138c-86c0-4d64-bb3a-b3f6fb841d23" -d '{"events": [{"server_uuid": "72a67d95-dbba-41d6-a26f-15844e8b9415", "name": "network-vif-plugged", "status": "completed", "tag": "c8b555e7-d683-4993-8750-7d3bfbdc6b8b"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:11:14.115725 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:14.117330 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port c8b555e7-d683-4993-8750-7d3bfbdc6b8b, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c8b555e7-d683-4993-8750-7d3bfbdc6b8b,segment=NetworkSegment(f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793),segment_id=f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:14.157779 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:11:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-01513c0e-1286-425c-88b1-1ab9ccb76172 x-openstack-request-id: req-01513c0e-1286-425c-88b1-1ab9ccb76172 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:11:14.158144 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "72a67d95-dbba-41d6-a26f-15844e8b9415", "name": "network-vif-plugged", "status": "completed", "tag": "c8b555e7-d683-4993-8750-7d3bfbdc6b8b", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:11:14.158475 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-01513c0e-1286-425c-88b1-1ab9ccb76172 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:11:14.158996 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '72a67d95-dbba-41d6-a26f-15844e8b9415', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c8b555e7-d683-4993-8750-7d3bfbdc6b8b', 'code': 200}
Jun 01 10:11:14.194123 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:14.196066 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:14.240706 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:14.268320 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=c8b555e7-d683-4993-8750-7d3bfbdc6b8b,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:14.271515 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:14.329969 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:14.335138 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-6775543f-5876-41c2-8be5-3857f518be26 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:14.400037 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:11:14.407513 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:11:14.413041 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:11:14.456616 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event updated for resources: {'Port': ['ID=dd7d47ff-2d30-4183-8be4-fa4d48638753,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:14.475982 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:14.476355 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:14.476720 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:14.477347 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:14.477453 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:14.477752 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:14.478101 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:14.478446 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:14.478796 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:14.479173 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:14.479517 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:14.479858 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:14.490202 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:14.560543 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4e3293f-a9f3-4a66-8093-49d51ada31fa req-cb261f80-7063-4ad6-b7d9-f3a0f207ab2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:14.563457 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d4e3293f-a9f3-4a66-8093-49d51ada31fa req-cb261f80-7063-4ad6-b7d9-f3a0f207ab2a service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 1098 time: 0.0929911
Jun 01 10:11:14.650370 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d4e3293f-a9f3-4a66-8093-49d51ada31fa req-f269849a-b966-4c46-b785-20e36e626b85 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0795789
Jun 01 10:11:14.696877 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58eb62e0-4169-404e-bd08-1d9686d94e98 req-26175b9f-9e3f-47a9-a1c2-4b73e8df9252 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:14.698696 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-58eb62e0-4169-404e-bd08-1d9686d94e98 req-26175b9f-9e3f-47a9-a1c2-4b73e8df9252 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0899899
Jun 01 10:11:14.793798 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-58eb62e0-4169-404e-bd08-1d9686d94e98 req-b0542f48-7b8e-49ea-b0f0-f097f6e5ee21 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0889108
Jun 01 10:11:14.830241 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aba20bd-0d4a-453d-8d82-520d708399f9 req-df2654a5-b0f4-4be8-9345-7d1640e3a9e1 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:14.832084 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3aba20bd-0d4a-453d-8d82-520d708399f9 req-df2654a5-b0f4-4be8-9345-7d1640e3a9e1 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 945 time: 0.1005027
Jun 01 10:11:14.879700 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3aba20bd-0d4a-453d-8d82-520d708399f9 req-0d03216e-5846-42a2-9b72-f75533a002db tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417192
Jun 01 10:11:14.997476 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:15.136681 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:15.340467 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:15.398442 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2295697'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:15.414255 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:15.533428 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event updated for resources: {'Port': ['ID=dd7d47ff-2d30-4183-8be4-fa4d48638753,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:15.537256 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:15.540034 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:15.722678 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.l3_db [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Floating IP 30889bd5-5712-4195-ae97-644587fcd5a3 associated. External IP: 172.27.2.247, port: 435c6b97-3648-4e27-92c7-12447506ef9f.
Jun 01 10:11:15.766204 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:15.813349 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3809a43-f142-4b83-babb-47ed53f3193a req-fabb3977-2342-4805-bf4d-f26450afadbb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:15.814953 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c3809a43-f142-4b83-babb-47ed53f3193a req-fabb3977-2342-4805-bf4d-f26450afadbb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.30 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.0902238
Jun 01 10:11:16.056193 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70776c9b-a4f1-40ef-a29c-d6c18d4f98e1 req-b5d9ded2-a071-4bdd-ab1e-6ef1fa013a4a tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:16.059428 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-70776c9b-a4f1-40ef-a29c-d6c18d4f98e1 req-b5d9ded2-a071-4bdd-ab1e-6ef1fa013a4a tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 945 time: 0.1385927
Jun 01 10:11:16.064290 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-c3809a43-f142-4b83-babb-47ed53f3193a req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Deleting port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:11:16.064626 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-c3809a43-f142-4b83-babb-47ed53f3193a req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:16.120466 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Router 426524f6-17bf-45cb-b42b-2fec9e039ff0 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:11:16.359001 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-70776c9b-a4f1-40ef-a29c-d6c18d4f98e1 req-d857dcc4-0b86-4b19-ab4d-8e989bb1cfbb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=ef889387-b500-43ef-a425-6324661f46cb&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2733545
Jun 01 10:11:16.388149 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-c3809a43-f142-4b83-babb-47ed53f3193a req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] For port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c4b8d4ae-e9e9-4d40-a923-e03752a7ad32,segment=NetworkSegment(2f350557-5423-4a12-a64b-0bf55f2578e6),segment_id=2f350557-5423-4a12-a64b-0bf55f2578e6)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:16.388503 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-c3809a43-f142-4b83-babb-47ed53f3193a req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:16.430024 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:11:16.441424 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-976db362-0d41-44ae-817b-af385507c9d5 None None] Sync routers for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:11:16.450727 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-976db362-0d41-44ae-817b-af385507c9d5 None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:11:16.451238 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-976db362-0d41-44ae-817b-af385507c9d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe725b79a0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:11:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:11:16.493061 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e071aa5e-ba67-413b-a171-83597df7f4d7 req-e882a0bf-afd2-4e1d-ae42-5624f80f39d9 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:16.494520 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e071aa5e-ba67-413b-a171-83597df7f4d7 req-e882a0bf-afd2-4e1d-ae42-5624f80f39d9 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 945 time: 0.2434406
Jun 01 10:11:16.535526 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:16.615422 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 2.9302647
Jun 01 10:11:16.616875 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4a01bc46-d5a0-4ef7-9aff-f160ee9d943f', 'tag': '435c6b97-3648-4e27-92c7-12447506ef9f'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:11:16.620133 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-df172cb6-8baa-4139-8daa-f5615e9fb33a" -d '{"events": [{"name": "network-changed", "server_uuid": "4a01bc46-d5a0-4ef7-9aff-f160ee9d943f", "tag": "435c6b97-3648-4e27-92c7-12447506ef9f"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:11:16.626594 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e071aa5e-ba67-413b-a171-83597df7f4d7 req-0ba7dc05-9dc3-496e-af79-2be8ac9cf625 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1222641
Jun 01 10:11:16.647054 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-976db362-0d41-44ae-817b-af385507c9d5 None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:11:16.690989 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:11:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34190eca-48cd-4750-b7a1-8794fcf4d19a x-openstack-request-id: req-34190eca-48cd-4750-b7a1-8794fcf4d19a {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:11:16.691498 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4a01bc46-d5a0-4ef7-9aff-f160ee9d943f", "tag": "435c6b97-3648-4e27-92c7-12447506ef9f", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:11:16.692141 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-34190eca-48cd-4750-b7a1-8794fcf4d19a {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:11:16.692752 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4a01bc46-d5a0-4ef7-9aff-f160ee9d943f', 'tag': '435c6b97-3648-4e27-92c7-12447506ef9f', 'status': 'completed', 'code': 200}
Jun 01 10:11:16.751219 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-c3809a43-f142-4b83-babb-47ed53f3193a req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:16.752119 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-c3809a43-f142-4b83-babb-47ed53f3193a req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:16.752367 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.l3_db [req-c3809a43-f142-4b83-babb-47ed53f3193a req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Floating IP 556f0a0e-eab7-43f4-9138-6ecc313144fd disassociated. External IP: 172.27.2.97, port: c4b8d4ae-e9e9-4d40-a923-e03752a7ad32.
Jun 01 10:11:16.752804 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-c3809a43-f142-4b83-babb-47ed53f3193a req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Calling delete_port for c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 owned by compute:nova {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:11:16.814970 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df172cb6-8baa-4139-8daa-f5615e9fb33a req-78d57de1-4ba8-49c1-82d0-c0a0b90b7492 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:16.815308 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-df172cb6-8baa-4139-8daa-f5615e9fb33a req-78d57de1-4ba8-49c1-82d0-c0a0b90b7492 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 1099 time: 0.0919619
Jun 01 10:11:16.963859 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df172cb6-8baa-4139-8daa-f5615e9fb33a req-0cfc0d8c-e6c9-4834-89dd-c6d871d9bd1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:16.965330 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-df172cb6-8baa-4139-8daa-f5615e9fb33a req-0cfc0d8c-e6c9-4834-89dd-c6d871d9bd1b service neutron] 10.222.0.30 "GET /v2.0/networks?id=83aff072-8820-4a36-b8f3-036a7011aace HTTP/1.1" status: 200  len: 910 time: 0.1429396
Jun 01 10:11:17.000485 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-c3809a43-f142-4b83-babb-47ed53f3193a req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:17.021977 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:17.046970 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-976db362-0d41-44ae-817b-af385507c9d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe725b79a0>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '30889bd5-5712-4195-ae97-644587fcd5a3', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'floating_ip_address': '172.27.2.247', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'port_id': '435c6b97-3648-4e27-92c7-12447506ef9f', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 433, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'mac_address': 'fa:16:3e:d3:ed:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a01bc46-d5a0-4ef7-9aff-f160ee9d943f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:11:14Z', 'updated_at': '2021-06-01T10:11:14Z', 'revision_number': 0, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:11:17.052152 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-976db362-0d41-44ae-817b-af385507c9d5 None None] Checking router: 426524f6-17bf-45cb-b42b-2fec9e039ff0 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:11:17.062633 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-976db362-0d41-44ae-817b-af385507c9d5 None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:11:17.065887 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-976db362-0d41-44ae-817b-af385507c9d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe725b79a0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:11:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:11:17.073024 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event deleted for resources: {'Port': ['ID=c4b8d4ae-e9e9-4d40-a923-e03752a7ad32,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:17.083992 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-df172cb6-8baa-4139-8daa-f5615e9fb33a req-286f7026-0fbd-4d0d-9324-2f9b491dc499 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=435c6b97-3648-4e27-92c7-12447506ef9f HTTP/1.1" status: 200  len: 1000 time: 0.1061378
Jun 01 10:11:17.152798 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:17.156087 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:17.156672 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:17.157699 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:17.157911 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df172cb6-8baa-4139-8daa-f5615e9fb33a req-2ea54133-b764-410e-b887-1815a635bcb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:17.158550 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:17.159103 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:17.159825 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-df172cb6-8baa-4139-8daa-f5615e9fb33a req-2ea54133-b764-410e-b887-1815a635bcb6 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=38dbf18a-9bde-4c4a-b149-d02ad12671d3 HTTP/1.1" status: 200  len: 848 time: 0.0672636
Jun 01 10:11:17.160327 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:17.160882 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:17.161240 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:17.162086 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:17.162448 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:17.162832 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:11:17.166305 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:17.245067 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df172cb6-8baa-4139-8daa-f5615e9fb33a req-89375d8f-f56a-44ed-95c2-2b0b8a9fa6da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:17.246729 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-df172cb6-8baa-4139-8daa-f5615e9fb33a req-89375d8f-f56a-44ed-95c2-2b0b8a9fa6da service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=83aff072-8820-4a36-b8f3-036a7011aace&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0742280
Jun 01 10:11:17.267260 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-976db362-0d41-44ae-817b-af385507c9d5 None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:11:17.319972 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [req-c3809a43-f142-4b83-babb-47ed53f3193a req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Router d0653611-f9db-4b67-b4b2-4c0789fb691f has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92566) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:11:17.456432 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-df172cb6-8baa-4139-8daa-f5615e9fb33a req-18ae65f8-9615-4b1d-b325-b8b0691f317e service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1941612
Jun 01 10:11:17.617878 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c3c2ac1d-7e17-4b55-b612-28bde8af5cb6 req-074e460f-9671-49f6-83ab-4bbfd16d08a8 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 210 time: 0.0488787
Jun 01 10:11:17.675097 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-c3809a43-f142-4b83-babb-47ed53f3193a req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:11:17.687723 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec78a57b-d9e5-49cb-840c-a9e6aeec07e4 None None] Sync routers for ids ['d0653611-f9db-4b67-b4b2-4c0789fb691f'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:11:17.711053 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec78a57b-d9e5-49cb-840c-a9e6aeec07e4 None None] Routers {'d0653611-f9db-4b67-b4b2-4c0789fb691f'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:11:17.711053 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-ec78a57b-d9e5-49cb-840c-a9e6aeec07e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7271f910>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:11:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d0653611-f9db-4b67-b4b2-4c0789fb691f'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:11:17.730441 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-df172cb6-8baa-4139-8daa-f5615e9fb33a req-209c7504-6af8-4397-8d9d-f9ea6e9089c1 service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2637062
Jun 01 10:11:17.784616 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:11:17.831922 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:11:17.832269 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:11:17.868291 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-c3809a43-f142-4b83-babb-47ed53f3193a req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] No DVR routers for this DVR port c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 on host hv-cinder-78726 {{(pid=92566) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:11:17.872050 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-c3809a43-f142-4b83-babb-47ed53f3193a req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:17.878563 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3', 'name': 'network-vif-deleted', 'tag': 'c4b8d4ae-e9e9-4d40-a923-e03752a7ad32'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:11:17.884360 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eb1560db-bcda-4e2c-a903-56c1c4faffec" -d '{"events": [{"server_uuid": "0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3", "name": "network-vif-deleted", "tag": "c4b8d4ae-e9e9-4d40-a923-e03752a7ad32"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:11:17.934663 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-ec78a57b-d9e5-49cb-840c-a9e6aeec07e4 None None] Set router d0653611-f9db-4b67-b4b2-4c0789fb691f gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:11:17.960038 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-976db362-0d41-44ae-817b-af385507c9d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe725b79a0>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '30889bd5-5712-4195-ae97-644587fcd5a3', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'floating_ip_address': '172.27.2.247', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'port_id': '435c6b97-3648-4e27-92c7-12447506ef9f', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 433, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'mac_address': 'fa:16:3e:d3:ed:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a01bc46-d5a0-4ef7-9aff-f160ee9d943f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:11:14Z', 'updated_at': '2021-06-01T10:11:14Z', 'revision_number': 0, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:11:17.973540 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-976db362-0d41-44ae-817b-af385507c9d5 None None] The sync data for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi is: [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '30889bd5-5712-4195-ae97-644587fcd5a3', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'floating_ip_address': '172.27.2.247', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'port_id': '435c6b97-3648-4e27-92c7-12447506ef9f', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 433, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'mac_address': 'fa:16:3e:d3:ed:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4a01bc46-d5a0-4ef7-9aff-f160ee9d943f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:11:14Z', 'updated_at': '2021-06-01T10:11:14Z', 'revision_number': 0, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:11:17.984020 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c3809a43-f142-4b83-babb-47ed53f3193a req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.30 "DELETE /v2.0/ports/c4b8d4ae-e9e9-4d40-a923-e03752a7ad32 HTTP/1.1" status: 204  len: 173 time: 2.1614182
Jun 01 10:11:18.098393 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-2ba27dc7-bfae-4509-b0ca-eaab38317f0a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:18.100468 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-2ba27dc7-bfae-4509-b0ca-eaab38317f0a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/networks?id=95462097-1cc6-4207-9add-1b65afcf40ca HTTP/1.1" status: 200  len: 815 time: 0.3329506
Jun 01 10:11:18.110980 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:11:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f4cf7417-da44-471d-ba25-430a29d43176 x-openstack-request-id: req-f4cf7417-da44-471d-ba25-430a29d43176 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:11:18.110980 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3", "name": "network-vif-deleted", "tag": "c4b8d4ae-e9e9-4d40-a923-e03752a7ad32", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:11:18.110980 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-f4cf7417-da44-471d-ba25-430a29d43176 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:11:18.110980 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3', 'name': 'network-vif-deleted', 'tag': 'c4b8d4ae-e9e9-4d40-a923-e03752a7ad32', 'status': 'completed', 'code': 200}
Jun 01 10:11:18.122595 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-7c4646b2-57cb-47af-b67f-6519a3d041ec tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/quotas/4f2a9e1dcd084ba7aeb9c96724aea0fe HTTP/1.1" status: 200  len: 375 time: 0.0159333
Jun 01 10:11:18.248331 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc3d132f-f782-48b6-acf4-aea3b13ef783 None None] New status for floating IP 30889bd5-5712-4195-ae97-644587fcd5a3: ACTIVE {{(pid=92567) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:11:18.340601 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-e728d2e0-69b5-4932-aff6-4cbd61d6cdf0 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=4f2a9e1dcd084ba7aeb9c96724aea0fe&fields=id HTTP/1.1" status: 200  len: 348 time: 0.2112827
Jun 01 10:11:18.421432 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-ec78a57b-d9e5-49cb-840c-a9e6aeec07e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7271f910>, [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:10Z', 'revision_number': 4, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71', 'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'mac_address': 'fa:16:3e:a9:83:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:23Z', 'revision_number': 5, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'subnets': [{'id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:11:18.426024 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec78a57b-d9e5-49cb-840c-a9e6aeec07e4 None None] Checking router: d0653611-f9db-4b67-b4b2-4c0789fb691f for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:11:18.435594 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec78a57b-d9e5-49cb-840c-a9e6aeec07e4 None None] Routers {'d0653611-f9db-4b67-b4b2-4c0789fb691f'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:11:18.436655 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-ec78a57b-d9e5-49cb-840c-a9e6aeec07e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7271f910>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:11:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d0653611-f9db-4b67-b4b2-4c0789fb691f'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:11:18.522711 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-d41720de-d248-40eb-9910-94a178f262b1 service neutron] 10.222.0.68 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1711681
Jun 01 10:11:18.629030 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-ec78a57b-d9e5-49cb-840c-a9e6aeec07e4 None None] Set router d0653611-f9db-4b67-b4b2-4c0789fb691f gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:11:18.680168 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-8031f094-6a44-44ce-93c6-d3dbce0fece2 service neutron] 10.222.0.68 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1501868
Jun 01 10:11:18.868484 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-84d01c44-175c-41bc-ac92-c788dd6bbfcf req-170f2d4f-6b2d-4d5b-8597-81322bd21922 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Synchronizing usage tracker for tenant:d13dc1de700d428a8982ca87f11948d0 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:11:18.964415 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-ec78a57b-d9e5-49cb-840c-a9e6aeec07e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7271f910>, [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:10Z', 'revision_number': 4, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71', 'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'mac_address': 'fa:16:3e:a9:83:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:23Z', 'revision_number': 5, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'subnets': [{'id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:11:18.969092 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec78a57b-d9e5-49cb-840c-a9e6aeec07e4 None None] The sync data for ids ['d0653611-f9db-4b67-b4b2-4c0789fb691f'] in dv-cinder-787262-4-iscsi is: [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:10Z', 'revision_number': 4, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71', 'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'mac_address': 'fa:16:3e:a9:83:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:23Z', 'revision_number': 5, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'subnets': [{'id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:11:18.995788 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6d8b5841-6068-46e1-bf7b-8688b248a26a req-0e75c446-b495-4b58-b0eb-8e5ec998b4d1 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 210 time: 0.0491092
Jun 01 10:11:19.045775 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-84d01c44-175c-41bc-ac92-c788dd6bbfcf req-170f2d4f-6b2d-4d5b-8597-81322bd21922 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Unset dirty status for tenant:d13dc1de700d428a8982ca87f11948d0 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:11:19.060281 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-84d01c44-175c-41bc-ac92-c788dd6bbfcf req-170f2d4f-6b2d-4d5b-8597-81322bd21922 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=0785b3e4-7294-4ca6-ad51-ec9e8f1d82c3 HTTP/1.1" status: 200  len: 210 time: 0.2321858
Jun 01 10:11:19.264040 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aeda8f11-9ecc-4076-9a9b-73ab230fd0c2 None None] New status for floating IP 556f0a0e-eab7-43f4-9138-6ecc313144fd: DOWN {{(pid=92568) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:11:20.154897 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4b37379c-041d-495b-8157-4244c09fbb38 req-2618336f-7a87-4bf9-886a-b16ef3c72390 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 210 time: 0.0499873
Jun 01 10:11:20.250977 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 35670) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:11:20.317075 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-43c4a9c2-57bc-4343-92a0-311fb76ad908 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:20.345373 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-43c4a9c2-57bc-4343-92a0-311fb76ad908 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:20.484073 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-43c4a9c2-57bc-4343-92a0-311fb76ad908 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:20.489457 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-773296cb-c88c-4893-a361-0c8bd7007eb0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:20.505155 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43c4a9c2-57bc-4343-92a0-311fb76ad908 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef889387-b500-43ef-a425-6324661f46cb,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:20.507568 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-43c4a9c2-57bc-4343-92a0-311fb76ad908 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:20.576270 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-43c4a9c2-57bc-4343-92a0-311fb76ad908 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:20.577375 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-43c4a9c2-57bc-4343-92a0-311fb76ad908 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "DELETE /v2.0/security-groups/ef889387-b500-43ef-a425-6324661f46cb HTTP/1.1" status: 204  len: 168 time: 0.3254783
Jun 01 10:11:20.580654 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 35674) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:11:20.597013 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.api.v2.resource [None req-0d410d56-81ad-4715-b1f2-102dc3485dec tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] show failed (client error): The resource could not be found.
Jun 01 10:11:20.597981 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-0d410d56-81ad-4715-b1f2-102dc3485dec tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups/ef889387-b500-43ef-a425-6324661f46cb HTTP/1.1" status: 404  len: 347 time: 0.0164499
Jun 01 10:11:20.606783 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 35678) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:11:20.827849 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-0e240795-85db-499a-b6bf-4108d5409117 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Deleting port 2a5e6d0f-fcce-4d41-a102-68d2d2a33315 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:11:20.828699 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0e240795-85db-499a-b6bf-4108d5409117 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:20.945262 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0e240795-85db-499a-b6bf-4108d5409117 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:20.945588 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0e240795-85db-499a-b6bf-4108d5409117 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:21.159930 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-0e240795-85db-499a-b6bf-4108d5409117 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Calling delete_port for 2a5e6d0f-fcce-4d41-a102-68d2d2a33315 owned by network:floatingip {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:11:21.389270 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0e240795-85db-499a-b6bf-4108d5409117 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:21.398527 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e01fd609-005a-435d-b42f-f3cffcfc5c21 req-a15051a1-797f-43db-afa5-49b697c7f35f tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 210 time: 0.0609970
Jun 01 10:11:21.402155 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:21.457432 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-e4d1eaa7-2429-4c86-9ba2-8bd6e0efdc2e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:21.458990 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-e4d1eaa7-2429-4c86-9ba2-8bd6e0efdc2e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.30 "GET /v2.0/networks?id=95462097-1cc6-4207-9add-1b65afcf40ca HTTP/1.1" status: 200  len: 815 time: 0.2126765
Jun 01 10:11:21.475144 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-762b8afc-21da-4d22-ab61-e550af3e56dd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Request body: {'port': {'device_id': 'c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf', 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca', 'admin_state_up': True, 'tenant_id': '4f2a9e1dcd084ba7aeb9c96724aea0fe'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:11:21.487165 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e240795-85db-499a-b6bf-4108d5409117 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event deleted for resources: {'Port': ['ID=2a5e6d0f-fcce-4d41-a102-68d2d2a33315,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:21.517200 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-0e240795-85db-499a-b6bf-4108d5409117 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:21.544659 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0e240795-85db-499a-b6bf-4108d5409117 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for floatingip, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:21.613028 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-762b8afc-21da-4d22-ab61-e550af3e56dd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:11:21.623082 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-762b8afc-21da-4d22-ab61-e550af3e56dd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:11:21.639670 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-0e240795-85db-499a-b6bf-4108d5409117 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:21.640843 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-0e240795-85db-499a-b6bf-4108d5409117 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "DELETE /v2.0/floatingips/556f0a0e-eab7-43f4-9138-6ecc313144fd HTTP/1.1" status: 204  len: 168 time: 1.0329235
Jun 01 10:11:21.732105 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-762b8afc-21da-4d22-ab61-e550af3e56dd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Made reservation on behalf of 4f2a9e1dcd084ba7aeb9c96724aea0fe for: {'port': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:11:21.737451 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-762b8afc-21da-4d22-ab61-e550af3e56dd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:21.903709 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-762b8afc-21da-4d22-ab61-e550af3e56dd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Allocated IP 172.20.0.14 (95462097-1cc6-4207-9add-1b65afcf40ca/abf69321-90c0-4336-ac76-6ef3766e6a67/541527f1-71e0-499b-8967-92c50bd692ae) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:11:21.947070 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 35694) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:11:21.952783 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-1de5a316-0882-4de1-b927-db6106aa26cb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Request body: {'security_group': {'name': 'tempest-securitygroup--40498333', 'description': 'tempest-description--1242778544'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:11:21.958923 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-1de5a316-0882-4de1-b927-db6106aa26cb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:11:21.962983 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-1de5a316-0882-4de1-b927-db6106aa26cb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Usage tracker for resource:security_group and tenant:d13dc1de700d428a8982ca87f11948d0 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:11:21.965803 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-1de5a316-0882-4de1-b927-db6106aa26cb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:11:21.972049 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-1de5a316-0882-4de1-b927-db6106aa26cb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:11:22.051008 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1de5a316-0882-4de1-b927-db6106aa26cb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:22.072324 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-1de5a316-0882-4de1-b927-db6106aa26cb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:11:22.076137 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-1de5a316-0882-4de1-b927-db6106aa26cb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Usage tracker for resource:security_group_rule and tenant:d13dc1de700d428a8982ca87f11948d0 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:11:22.079496 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-1de5a316-0882-4de1-b927-db6106aa26cb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:11:22.085149 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-1de5a316-0882-4de1-b927-db6106aa26cb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:11:22.119353 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-762b8afc-21da-4d22-ab61-e550af3e56dd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:22.160497 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1de5a316-0882-4de1-b927-db6106aa26cb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:22.217477 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-762b8afc-21da-4d22-ab61-e550af3e56dd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:22.223804 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b06cd984-bddf-4241-912f-3666a4a003cc tempest-VolumesActionsTest-1849369402 tempest-VolumesActionsTest-1849369402-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:22.229625 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['6010d8c0-403f-4393-8c5c-fd9cc14aeecb', '41cda8ce-e474-41cf-9b05-6c4a119eed48', 'c6da8fab-3cf3-43a2-aff8-b6f43e149b0a'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:11:22.263348 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1de5a316-0882-4de1-b927-db6106aa26cb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:22.268509 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-d8ea83e1-849d-455f-aea4-492f72ac80b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:22.287027 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-762b8afc-21da-4d22-ab61-e550af3e56dd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Network 95462097-1cc6-4207-9add-1b65afcf40ca is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:11:22.290223 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-762b8afc-21da-4d22-ab61-e550af3e56dd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:11:22.294301 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-762b8afc-21da-4d22-ab61-e550af3e56dd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:11:22.332975 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-762b8afc-21da-4d22-ab61-e550af3e56dd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Pushing event updated for resources: {'Port': ['ID=541527f1-71e0-499b-8967-92c50bd692ae,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:22.334781 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1de5a316-0882-4de1-b927-db6106aa26cb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0500c211-3c38-4c74-b22c-0c81d01aa31a,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:22.338045 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-762b8afc-21da-4d22-ab61-e550af3e56dd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:22.345808 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-1de5a316-0882-4de1-b927-db6106aa26cb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:22.370092 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-762b8afc-21da-4d22-ab61-e550af3e56dd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:22.370975 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-762b8afc-21da-4d22-ab61-e550af3e56dd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:22.400664 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1de5a316-0882-4de1-b927-db6106aa26cb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:22.404815 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-1de5a316-0882-4de1-b927-db6106aa26cb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1778 time: 0.4539580
Jun 01 10:11:22.405341 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 35700) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:11:22.412030 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-b6f81d7e-616b-4c5a-962b-bfae6d819f5e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Request body: {'security_group_rule': {'security_group_id': '0500c211-3c38-4c74-b22c-0c81d01aa31a', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:11:22.425414 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-b6f81d7e-616b-4c5a-962b-bfae6d819f5e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:11:22.429713 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-b6f81d7e-616b-4c5a-962b-bfae6d819f5e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Usage tracker for resource:security_group_rule and tenant:d13dc1de700d428a8982ca87f11948d0 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:11:22.433124 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-b6f81d7e-616b-4c5a-962b-bfae6d819f5e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:11:22.440081 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-b6f81d7e-616b-4c5a-962b-bfae6d819f5e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:11:22.482145 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-762b8afc-21da-4d22-ab61-e550af3e56dd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.0092206
Jun 01 10:11:22.548731 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b6f81d7e-616b-4c5a-962b-bfae6d819f5e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:22.575621 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Request body: {'port': {'device_id': 'c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:11:22.619266 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b6f81d7e-616b-4c5a-962b-bfae6d819f5e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:22.706613 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b6f81d7e-616b-4c5a-962b-bfae6d819f5e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:22.708752 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:22.709071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:22.731151 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6f81d7e-616b-4c5a-962b-bfae6d819f5e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=707277dc-9d84-4a0f-aa19-f688e24cd5b9,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:22.731613 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80f084f7-a4c4-4468-8a00-19463686a25e req-ab04bc7e-9e06-4bce-85ba-48d266a22ed7 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:22.732382 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-80f084f7-a4c4-4468-8a00-19463686a25e req-ab04bc7e-9e06-4bce-85ba-48d266a22ed7 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Synchronizing usage tracker for tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:11:22.733580 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b6f81d7e-616b-4c5a-962b-bfae6d819f5e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:22.799640 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b6f81d7e-616b-4c5a-962b-bfae6d819f5e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:22.800867 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-b6f81d7e-616b-4c5a-962b-bfae6d819f5e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3942509
Jun 01 10:11:22.803589 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 35710) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:11:22.808598 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-d65d1cf8-7a7a-4f56-8b20-0e189fb48403 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Request body: {'security_group_rule': {'security_group_id': '0500c211-3c38-4c74-b22c-0c81d01aa31a', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:11:22.814881 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-d65d1cf8-7a7a-4f56-8b20-0e189fb48403 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:11:22.818613 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-d65d1cf8-7a7a-4f56-8b20-0e189fb48403 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Usage tracker for resource:security_group_rule and tenant:d13dc1de700d428a8982ca87f11948d0 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:11:22.821451 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-d65d1cf8-7a7a-4f56-8b20-0e189fb48403 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:11:22.827167 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-d65d1cf8-7a7a-4f56-8b20-0e189fb48403 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:11:22.915428 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d65d1cf8-7a7a-4f56-8b20-0e189fb48403 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:22.935662 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-80f084f7-a4c4-4468-8a00-19463686a25e req-ab04bc7e-9e06-4bce-85ba-48d266a22ed7 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Unset dirty status for tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:11:22.936813 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-80f084f7-a4c4-4468-8a00-19463686a25e req-ab04bc7e-9e06-4bce-85ba-48d266a22ed7 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 932 time: 0.4154632
Jun 01 10:11:22.981269 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d65d1cf8-7a7a-4f56-8b20-0e189fb48403 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:23.051414 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d65d1cf8-7a7a-4f56-8b20-0e189fb48403 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:23.053489 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-9ade90de-a1ec-4eb2-8a14-0eb97163909a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:23.057384 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-80f084f7-a4c4-4468-8a00-19463686a25e req-f57beef5-6d18-4b05-819c-86a64c221321 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1134923
Jun 01 10:11:23.076483 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d65d1cf8-7a7a-4f56-8b20-0e189fb48403 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d608efca-d794-4346-b315-2634e1b80307,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:23.079797 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-d65d1cf8-7a7a-4f56-8b20-0e189fb48403 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:23.132875 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d65d1cf8-7a7a-4f56-8b20-0e189fb48403 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:23.134094 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-d65d1cf8-7a7a-4f56-8b20-0e189fb48403 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.3296010
Jun 01 10:11:23.161269 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 35714) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:11:23.176296 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Request body: {'floatingip': {'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:11:23.183589 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:11:23.190888 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Usage tracker for resource:floatingip and tenant:d13dc1de700d428a8982ca87f11948d0 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:11:23.195427 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:11:23.202276 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4b45193c-83b5-4f1a-9aff-acfd282b3210 req-fd8f30d6-9b5b-4ee7-aba0-64380e3cf501 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0706418
Jun 01 10:11:23.203769 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:11:23.206925 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 541527f1-71e0-499b-8967-92c50bd692ae {{(pid=92566) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:11:23.216051 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:23.231730 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Transition to ACTIVE for port object 541527f1-71e0-499b-8967-92c50bd692ae will not be triggered until provisioned by entity L2. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:11:23.308597 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for floatingip, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:23.353429 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b45193c-83b5-4f1a-9aff-acfd282b3210 req-f2acfd27-29a7-4fdc-a220-2a1704b7533d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:23.354944 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4b45193c-83b5-4f1a-9aff-acfd282b3210 req-f2acfd27-29a7-4fdc-a220-2a1704b7533d service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=4f2a9e1dcd084ba7aeb9c96724aea0fe&device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 1098 time: 0.0755413
Jun 01 10:11:23.382307 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:23.389048 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-51f00d0b-cec4-42d3-a5e3-9244b7e18944 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:23.508705 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b45193c-83b5-4f1a-9aff-acfd282b3210 req-adf137eb-6a18-4c82-b66d-f960e8aff5b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:23.511188 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4b45193c-83b5-4f1a-9aff-acfd282b3210 req-adf137eb-6a18-4c82-b66d-f960e8aff5b6 service neutron] 10.222.0.30 "GET /v2.0/networks?id=95462097-1cc6-4207-9add-1b65afcf40ca HTTP/1.1" status: 200  len: 916 time: 0.1337965
Jun 01 10:11:23.530150 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Pushing event updated for resources: {'Port': ['ID=541527f1-71e0-499b-8967-92c50bd692ae,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:23.533484 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:23.582430 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4b45193c-83b5-4f1a-9aff-acfd282b3210 req-fbe79c46-ddd7-4a60-937a-c2902d82d500 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=6010d8c0-403f-4393-8c5c-fd9cc14aeecb HTTP/1.1" status: 200  len: 217 time: 0.0609422
Jun 01 10:11:23.657598 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b45193c-83b5-4f1a-9aff-acfd282b3210 req-27408e8e-298e-4507-8a1a-e59dc4af7702 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:23.658654 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Attempting to bind port 541527f1-71e0-499b-8967-92c50bd692ae on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:11:23.658999 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Attempting to bind port 541527f1-71e0-499b-8967-92c50bd692ae by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': 'f512f187-5724-4ff7-afd5-c422b0bd8ba7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca'}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:11:23.659222 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4b45193c-83b5-4f1a-9aff-acfd282b3210 req-27408e8e-298e-4507-8a1a-e59dc4af7702 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=abf69321-90c0-4336-ac76-6ef3766e6a67 HTTP/1.1" status: 200  len: 855 time: 0.0667918
Jun 01 10:11:23.659352 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Attempting to bind port 541527f1-71e0-499b-8967-92c50bd692ae on network 95462097-1cc6-4207-9add-1b65afcf40ca {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:11:23.666829 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Port 541527f1-71e0-499b-8967-92c50bd692ae on network 95462097-1cc6-4207-9add-1b65afcf40ca not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:11:23.667158 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Attempting to bind port 541527f1-71e0-499b-8967-92c50bd692ae on network 95462097-1cc6-4207-9add-1b65afcf40ca {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:11:23.676857 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 10, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:11:23.677195 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Checking segment: {'id': 'f512f187-5724-4ff7-afd5-c422b0bd8ba7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:11:23.677574 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Bound using segment: {'id': 'f512f187-5724-4ff7-afd5-c422b0bd8ba7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca'} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:11:23.677998 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Bound port: 541527f1-71e0-499b-8967-92c50bd692ae, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f512f187-5724-4ff7-afd5-c422b0bd8ba7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca'}}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:11:23.678341 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:23.689223 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:23.711954 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4b45193c-83b5-4f1a-9aff-acfd282b3210 req-7555acfd-4e74-4319-8f40-a61118daafab service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=95462097-1cc6-4207-9add-1b65afcf40ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0419888
Jun 01 10:11:23.850007 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4b45193c-83b5-4f1a-9aff-acfd282b3210 req-656cf6c9-04b4-46a1-b9a5-f0f43dc59ab7 service neutron] 10.222.0.30 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1273425
Jun 01 10:11:23.868113 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] For port 541527f1-71e0-499b-8967-92c50bd692ae, host hv-cinder-78726, cleared binding levels {{(pid=92566) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:11:23.881639 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] For port 541527f1-71e0-499b-8967-92c50bd692ae, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=541527f1-71e0-499b-8967-92c50bd692ae,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92566) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:11:23.897138 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Allocated IP 172.27.2.112 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/802c8745-3b6c-4cd6-b5df-c981b1a002c7) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:11:23.976246 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:23.982531 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7479306e-1b80-4ffc-be82-573919d0bd03 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:23.986504 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-4b45193c-83b5-4f1a-9aff-acfd282b3210 req-d6c7029f-cf15-450d-9004-0888ceaad43a service neutron] 10.222.0.30 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1285157
Jun 01 10:11:24.044907 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:24.045501 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:24.046861 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] 10.222.0.30 "PUT /v2.0/ports/541527f1-71e0-499b-8967-92c50bd692ae HTTP/1.1" status: 200  len: 1094 time: 1.5570424
Jun 01 10:11:24.049570 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf', 'tag': '541527f1-71e0-499b-8967-92c50bd692ae'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:11:24.051801 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9da00628-1a4c-4005-a924-43524cdaedb0" -d '{"events": [{"name": "network-changed", "server_uuid": "c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf", "tag": "541527f1-71e0-499b-8967-92c50bd692ae"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:11:24.096591 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:11:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c5129224-338a-488a-9245-80811c23d06e x-openstack-request-id: req-c5129224-338a-488a-9245-80811c23d06e {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:11:24.096908 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf", "tag": "541527f1-71e0-499b-8967-92c50bd692ae", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:11:24.097186 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-c5129224-338a-488a-9245-80811c23d06e {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:11:24.097592 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf', 'tag': '541527f1-71e0-499b-8967-92c50bd692ae', 'status': 'completed', 'code': 200}
Jun 01 10:11:24.100581 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Pushing event updated for resources: {'Port': ['ID=541527f1-71e0-499b-8967-92c50bd692ae,revision_number=3']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:24.104903 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:24.123459 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:24.283060 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da00628-1a4c-4005-a924-43524cdaedb0 req-b421cce9-1a8e-4348-a5c4-e2db9117b8d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:24.284534 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9da00628-1a4c-4005-a924-43524cdaedb0 req-b421cce9-1a8e-4348-a5c4-e2db9117b8d2 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=4f2a9e1dcd084ba7aeb9c96724aea0fe&device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 1097 time: 0.1572878
Jun 01 10:11:24.294892 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7195e95b-c539-4469-9e5d-1dade17e7214 req-9a0b5937-8c3c-4a6d-a17d-7843473732b5 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:24.296269 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7195e95b-c539-4469-9e5d-1dade17e7214 req-9a0b5937-8c3c-4a6d-a17d-7843473732b5 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 944 time: 0.1169729
Jun 01 10:11:24.406182 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:24.413988 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-ddcb04b1-3ba6-4146-ad19-43e6bf406390 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:24.492208 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7195e95b-c539-4469-9e5d-1dade17e7214 req-eaa8f843-808f-4e15-b0e9-e6c1de47fee0 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1714749
Jun 01 10:11:24.493863 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:11:24.501200 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:11:24.506923 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:11:24.559245 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event updated for resources: {'Port': ['ID=802c8745-3b6c-4cd6-b5df-c981b1a002c7,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:24.570775 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:24.590959 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da00628-1a4c-4005-a924-43524cdaedb0 req-78b557ca-e63a-48b2-bc4b-5f77719524f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:24.592407 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9da00628-1a4c-4005-a924-43524cdaedb0 req-78b557ca-e63a-48b2-bc4b-5f77719524f6 service neutron] 10.222.0.30 "GET /v2.0/networks?tenant_id=4f2a9e1dcd084ba7aeb9c96724aea0fe&shared=False HTTP/1.1" status: 200  len: 916 time: 0.2947679
Jun 01 10:11:24.844488 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:24.889072 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da00628-1a4c-4005-a924-43524cdaedb0 req-c73b3df7-c745-4453-81f2-e5e5e6c7537e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:24.890548 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9da00628-1a4c-4005-a924-43524cdaedb0 req-c73b3df7-c745-4453-81f2-e5e5e6c7537e service neutron] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1620042
Jun 01 10:11:25.028678 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:25.119427 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-8457e21e-01df-49e3-94b7-1d2d246f6e88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:25.120888 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-8457e21e-01df-49e3-94b7-1d2d246f6e88 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=4f2a9e1dcd084ba7aeb9c96724aea0fe&device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 1097 time: 0.1700926
Jun 01 10:11:25.246543 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-dde9d0c1-e9ab-45da-bbf8-2f67d10d265c service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=541527f1-71e0-499b-8967-92c50bd692ae HTTP/1.1" status: 200  len: 217 time: 0.0766463
Jun 01 10:11:25.348235 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-eecc1605-153d-4605-86f0-310fd5645afd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:25.349586 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-eecc1605-153d-4605-86f0-310fd5645afd service neutron] 10.222.0.30 "GET /v2.0/subnets?id=abf69321-90c0-4336-ac76-6ef3766e6a67 HTTP/1.1" status: 200  len: 855 time: 0.0822713
Jun 01 10:11:25.409556 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:25.412606 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-93aaee09-51d3-4ded-85b4-305234fee14d service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=95462097-1cc6-4207-9add-1b65afcf40ca&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0512533
Jun 01 10:11:25.507730 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:25.513094 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b96a8d90-365d-4186-8f1b-bebb50f662dd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:25.695477 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-ce735b54-2590-415c-a956-825344858c35 service neutron] 10.222.0.30 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2751808
Jun 01 10:11:25.699702 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event updated for resources: {'Port': ['ID=802c8745-3b6c-4cd6-b5df-c981b1a002c7,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:25.706454 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:25.797851 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:25.879677 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d34c80c-1e2b-4c08-8eba-a0a6d7dbbd5a req-df4c0602-68fb-427b-a754-70e7f917a71b tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:25.881273 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9d34c80c-1e2b-4c08-8eba-a0a6d7dbbd5a req-df4c0602-68fb-427b-a754-70e7f917a71b tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 944 time: 0.2708678
Jun 01 10:11:25.886673 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f74ef87d-6339-4ad1-a8ec-2a77caeabba1 req-186be2a7-7de0-40ac-b012-29cff2293d71 service neutron] 10.222.0.30 "GET /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1813962
Jun 01 10:11:25.903467 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:25.904596 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 2.7423084
Jun 01 10:11:25.929791 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9d34c80c-1e2b-4c08-8eba-a0a6d7dbbd5a req-67fa5982-59c3-4417-aac6-5a033b16b73a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421493
Jun 01 10:11:26.085425 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-fc549635-8326-4fe3-85c9-1949f0642607 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?name=tempest-securitygroup--40498333&fields=id&tenant_id=d13dc1de700d428a8982ca87f11948d0 HTTP/1.1" status: 200  len: 267 time: 0.0441809
Jun 01 10:11:26.234444 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-1e0d02fc-c8e8-43d6-b238-76c47729413e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:26.235864 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-1e0d02fc-c8e8-43d6-b238-76c47729413e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/networks?id=3d9ff4d3-b145-4108-a593-976a9cfb63dc HTTP/1.1" status: 200  len: 810 time: 0.1441317
Jun 01 10:11:26.251632 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-4d99fa9b-2822-448e-bf4b-d55ab92f11e8 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/quotas/d13dc1de700d428a8982ca87f11948d0 HTTP/1.1" status: 200  len: 375 time: 0.0097852
Jun 01 10:11:26.334518 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-bed89564-46c6-4797-a96d-dda4476d75c5 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=d13dc1de700d428a8982ca87f11948d0&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0777721
Jun 01 10:11:26.537190 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:26.554061 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3eb285e3-49e6-4e2d-bc73-6d4cf0099f9a service neutron] 10.222.0.68 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2081857
Jun 01 10:11:26.682360 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-bf59fb8b-94f1-419b-8100-eb331e035c54 service neutron] 10.222.0.68 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1222420
Jun 01 10:11:26.926730 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ba2a27d-faad-45b3-956d-f2c4cbbfa5e1 req-5f5f7037-0e5c-46bd-82bc-d594c4650f64 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 210 time: 0.0450909
Jun 01 10:11:27.120003 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4b43581-691c-43ef-a998-f08ae801aedc req-e3836559-08e8-4062-bab1-b5c12380fc9a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:27.122665 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a4b43581-691c-43ef-a998-f08ae801aedc req-e3836559-08e8-4062-bab1-b5c12380fc9a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 944 time: 0.0838201
Jun 01 10:11:27.169755 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a4b43581-691c-43ef-a998-f08ae801aedc req-e89d5aed-ae47-4754-9c09-3c50fc4f0615 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410025
Jun 01 10:11:28.081838 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a61e6a0a-2d89-4184-acc9-7d5816a94ad5 req-46ab6f00-4704-4131-981b-154aabe00039 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 210 time: 0.0415325
Jun 01 10:11:28.362885 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b041f7c0-84fa-48b4-846f-5157beb50c25 req-4dba6920-60c2-45fd-8c54-9e4de7bc3fad tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:28.364729 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b041f7c0-84fa-48b4-846f-5157beb50c25 req-4dba6920-60c2-45fd-8c54-9e4de7bc3fad tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 944 time: 0.0846746
Jun 01 10:11:28.408610 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b041f7c0-84fa-48b4-846f-5157beb50c25 req-bea7e934-8903-478c-b3d9-3416d2803586 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384247
Jun 01 10:11:29.225757 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6d912742-182c-457a-8b6b-372997012092 req-2c3c335c-1041-4e2e-abee-419c5d323605 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 210 time: 0.0415745
Jun 01 10:11:29.590537 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad5e06d8-0413-4a4f-ad2a-0ae50684c9e3 req-9fd3622c-1363-4ac3-a8e5-b05d880933e4 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:29.591989 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ad5e06d8-0413-4a4f-ad2a-0ae50684c9e3 req-9fd3622c-1363-4ac3-a8e5-b05d880933e4 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 944 time: 0.0824397
Jun 01 10:11:29.635271 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ad5e06d8-0413-4a4f-ad2a-0ae50684c9e3 req-aeb05172-bdd0-4559-9280-fe98ea37e86e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0370243
Jun 01 10:11:30.374101 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4672d0c3-d1d3-4da7-a355-d8e3975c8eeb req-efdb3849-d030-43fb-bc18-00822a5488d0 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 210 time: 0.0428987
Jun 01 10:11:30.790369 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 541527f1-71e0-499b-8967-92c50bd692ae details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:11:30.822095 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ff5aec6-61cf-44fb-b13a-565ac9b47e35 req-b4c3c4f9-8036-4621-a6a0-3695b683efbc tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:30.824797 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3ff5aec6-61cf-44fb-b13a-565ac9b47e35 req-b4c3c4f9-8036-4621-a6a0-3695b683efbc tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 944 time: 0.0856791
Jun 01 10:11:30.875795 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3ff5aec6-61cf-44fb-b13a-565ac9b47e35 req-55f1c9dc-60ca-4848-ba00-727473e9d124 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0448120
Jun 01 10:11:30.925338 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 541527f1-71e0-499b-8967-92c50bd692ae, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=541527f1-71e0-499b-8967-92c50bd692ae,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:30.938346 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': '541527f1-71e0-499b-8967-92c50bd692ae', 'network_id': '95462097-1cc6-4207-9add-1b65afcf40ca', 'port_id': '541527f1-71e0-499b-8967-92c50bd692ae', 'mac_address': 'fa:16:3e:36:b1:ab', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 897, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'abf69321-90c0-4336-ac76-6ef3766e6a67', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:11:30.993826 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:31.010405 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 541527f1-71e0-499b-8967-92c50bd692ae {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:11:31.026083 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 541527f1-71e0-499b-8967-92c50bd692ae, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=541527f1-71e0-499b-8967-92c50bd692ae,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:31.102322 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:31.104262 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:31.173298 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=541527f1-71e0-499b-8967-92c50bd692ae,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:31.176407 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:31.450707 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['541527f1-71e0-499b-8967-92c50bd692ae'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:11:31.529899 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8aedb6de-8f4c-467e-8f27-80aed58317b1 req-e2ecba6c-5d61-46c1-a19f-585612302083 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 210 time: 0.0468900
Jun 01 10:11:31.957354 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-a9517134-26a7-43bd-b8eb-2313a8286021 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:31.959117 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-a9517134-26a7-43bd-b8eb-2313a8286021 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.30 "GET /v2.0/networks?id=3d9ff4d3-b145-4108-a593-976a9cfb63dc HTTP/1.1" status: 200  len: 810 time: 0.1716259
Jun 01 10:11:32.069435 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-f41ede13-d898-401c-a9e5-e25664bd8abe tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d13dc1de700d428a8982ca87f11948d0 HTTP/1.1" status: 200  len: 378 time: 0.0946805
Jun 01 10:11:32.081959 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Request body: {'port': {'device_id': '3d232d55-724b-4a23-aa21-e4bdea0e204a', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'admin_state_up': True, 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'security_groups': ['0500c211-3c38-4c74-b22c-0c81d01aa31a']}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:11:32.186810 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb543d19-a9c7-4f72-a2e2-c47e84fbeedd req-a0e6d622-882b-4a1b-a13a-cd8ca654bfaf tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:32.188354 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cb543d19-a9c7-4f72-a2e2-c47e84fbeedd req-a0e6d622-882b-4a1b-a13a-cd8ca654bfaf tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 945 time: 0.1953900
Jun 01 10:11:32.271644 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cb543d19-a9c7-4f72-a2e2-c47e84fbeedd req-27c289f3-9fa8-4f31-be88-551c36a8fdf1 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0767758
Jun 01 10:11:32.272555 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:11:32.276849 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Usage tracker for resource:port and tenant:d13dc1de700d428a8982ca87f11948d0 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:11:32.280004 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Quota usage for port was recalculated. Used quota:3. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:11:32.286731 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:11:32.360242 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Made reservation on behalf of d13dc1de700d428a8982ca87f11948d0 for: {'port': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:11:32.364004 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:32.523153 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Allocated IP 172.20.0.13 (3d9ff4d3-b145-4108-a593-976a9cfb63dc/2a00a573-a4bb-4d2d-a3e6-7aef03966618/9206018f-e096-4bbf-be0f-57a111993b66) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:11:32.691173 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-268f34fa-2040-4d99-a685-6f9d9baef234 req-b1937aec-1b68-4944-b239-50b17140f2ca tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 210 time: 0.0530305
Jun 01 10:11:32.746662 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:32.761963 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Transition to ACTIVE for port object 9206018f-e096-4bbf-be0f-57a111993b66 will not be triggered until provisioned by entity DHCP. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:11:32.840115 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:32.845767 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:32.990838 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Network 3d9ff4d3-b145-4108-a593-976a9cfb63dc is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:11:32.994071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:11:32.998127 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:11:33.029600 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event updated for resources: {'Port': ['ID=9206018f-e096-4bbf-be0f-57a111993b66,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:33.036083 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:33.070255 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:33.070860 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:33.159039 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.0833316
Jun 01 10:11:33.278272 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-c6fa4329-ffaa-4515-9345-8f3aade86b1b None None] Provisioning for port 9206018f-e096-4bbf-be0f-57a111993b66 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:11:33.283227 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-c6fa4329-ffaa-4515-9345-8f3aade86b1b None None] Provisioning complete for port 9206018f-e096-4bbf-be0f-57a111993b66 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:11:33.283598 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-c6fa4329-ffaa-4515-9345-8f3aade86b1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:33.338218 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-c6fa4329-ffaa-4515-9345-8f3aade86b1b None None] Port 9206018f-e096-4bbf-be0f-57a111993b66 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:11:33.460073 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0df7fa5-8f3c-4221-ba8f-798e5c364ea6 req-088e3449-b796-4fde-a55b-02c5ab0681ad tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:33.461534 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d0df7fa5-8f3c-4221-ba8f-798e5c364ea6 req-088e3449-b796-4fde-a55b-02c5ab0681ad tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 945 time: 0.0804925
Jun 01 10:11:33.507327 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d0df7fa5-8f3c-4221-ba8f-798e5c364ea6 req-481dc617-6c12-47f6-81b3-f7e2d4407481 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401101
Jun 01 10:11:33.875480 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c8ef835-dd22-4a93-881a-0797c41c1c19 req-0a1eea4b-855e-4453-bd3b-21050d7fe956 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:33.876157 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-4c8ef835-dd22-4a93-881a-0797c41c1c19 req-0a1eea4b-855e-4453-bd3b-21050d7fe956 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Synchronizing usage tracker for tenant:d13dc1de700d428a8982ca87f11948d0 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:11:33.963823 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-4c8ef835-dd22-4a93-881a-0797c41c1c19 req-0a1eea4b-855e-4453-bd3b-21050d7fe956 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Unset dirty status for tenant:d13dc1de700d428a8982ca87f11948d0 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:11:33.964978 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4c8ef835-dd22-4a93-881a-0797c41c1c19 req-0a1eea4b-855e-4453-bd3b-21050d7fe956 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 932 time: 0.1674237
Jun 01 10:11:34.013706 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4c8ef835-dd22-4a93-881a-0797c41c1c19 req-4de303e8-73ff-4162-8528-d605c1400d68 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=0500c211-3c38-4c74-b22c-0c81d01aa31a&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0430355
Jun 01 10:11:34.689010 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd6bf146-0563-4eb0-9c4b-acad4d2931c9 req-a40b7202-5fd1-4f75-acdf-738c6066c014 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:34.690429 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dd6bf146-0563-4eb0-9c4b-acad4d2931c9 req-a40b7202-5fd1-4f75-acdf-738c6066c014 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 945 time: 0.0773299
Jun 01 10:11:34.733769 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dd6bf146-0563-4eb0-9c4b-acad4d2931c9 req-e82d256a-880b-47ba-9e6c-f421ed64e2e2 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0377810
Jun 01 10:11:35.198086 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2953677f-73cc-42a2-8d15-29f32dd5947e req-7d9ad956-6545-4416-ae53-27fcaf35c02e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:35.199551 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2953677f-73cc-42a2-8d15-29f32dd5947e req-7d9ad956-6545-4416-ae53-27fcaf35c02e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 932 time: 0.0824420
Jun 01 10:11:35.244068 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2953677f-73cc-42a2-8d15-29f32dd5947e req-8be484a7-bad8-478b-9477-6ed0f6099a37 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=0500c211-3c38-4c74-b22c-0c81d01aa31a&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0380917
Jun 01 10:11:35.454998 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Request body: {'port': {'device_id': '3d232d55-724b-4a23-aa21-e4bdea0e204a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:11:35.564726 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:35.950006 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9206018f-e096-4bbf-be0f-57a111993b66 {{(pid=92566) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:11:35.960096 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:35.979847 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Transition to ACTIVE for port object 9206018f-e096-4bbf-be0f-57a111993b66 will not be triggered until provisioned by entity L2. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:11:35.994431 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec1d08d3-d1fa-45e7-a822-b62ab4a5ca12 req-dbe618b0-497c-4f07-b5dc-28d94dcc29ba tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:35.995968 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ec1d08d3-d1fa-45e7-a822-b62ab4a5ca12 req-dbe618b0-497c-4f07-b5dc-28d94dcc29ba tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 945 time: 0.1479800
Jun 01 10:11:36.040768 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ec1d08d3-d1fa-45e7-a822-b62ab4a5ca12 req-b88a4247-d449-4913-8dac-27a07970d236 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384750
Jun 01 10:11:36.045077 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:36.049756 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-41a08241-be14-42fc-a76b-0a8d807f3468 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:36.200484 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Pushing event updated for resources: {'Port': ['ID=9206018f-e096-4bbf-be0f-57a111993b66,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:36.208082 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:36.292584 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Attempting to bind port 9206018f-e096-4bbf-be0f-57a111993b66 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:11:36.292883 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Attempting to bind port 9206018f-e096-4bbf-be0f-57a111993b66 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '2f350557-5423-4a12-a64b-0bf55f2578e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc'}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:11:36.293203 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Attempting to bind port 9206018f-e096-4bbf-be0f-57a111993b66 on network 3d9ff4d3-b145-4108-a593-976a9cfb63dc {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:11:36.298490 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Port 9206018f-e096-4bbf-be0f-57a111993b66 on network 3d9ff4d3-b145-4108-a593-976a9cfb63dc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:11:36.298798 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Attempting to bind port 9206018f-e096-4bbf-be0f-57a111993b66 on network 3d9ff4d3-b145-4108-a593-976a9cfb63dc {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:11:36.304186 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 11, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:11:36.304512 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Checking segment: {'id': '2f350557-5423-4a12-a64b-0bf55f2578e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:11:36.304885 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Bound using segment: {'id': '2f350557-5423-4a12-a64b-0bf55f2578e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc'} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:11:36.305302 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Bound port: 9206018f-e096-4bbf-be0f-57a111993b66, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2f350557-5423-4a12-a64b-0bf55f2578e6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc'}}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:11:36.305641 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:36.454231 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] For port 9206018f-e096-4bbf-be0f-57a111993b66, host hv-cinder-78726, cleared binding levels {{(pid=92566) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:11:36.458502 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] For port 9206018f-e096-4bbf-be0f-57a111993b66, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=9206018f-e096-4bbf-be0f-57a111993b66,segment=NetworkSegment(2f350557-5423-4a12-a64b-0bf55f2578e6),segment_id=2f350557-5423-4a12-a64b-0bf55f2578e6)] {{(pid=92566) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:11:36.474401 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c84d107-4814-4526-b9f7-9bf3da9ef064 req-9010b2fd-4258-4f0a-b2a7-4bd887b8ea72 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:36.475908 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0c84d107-4814-4526-b9f7-9bf3da9ef064 req-9010b2fd-4258-4f0a-b2a7-4bd887b8ea72 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 944 time: 0.1177838
Jun 01 10:11:36.523414 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0c84d107-4814-4526-b9f7-9bf3da9ef064 req-969408d6-ba6f-4d8f-bd3d-9c3f6185cf09 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=0500c211-3c38-4c74-b22c-0c81d01aa31a&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0415568
Jun 01 10:11:36.524592 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:36.528249 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:36.587738 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:36.588350 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:36.589722 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] 10.222.0.30 "PUT /v2.0/ports/9206018f-e096-4bbf-be0f-57a111993b66 HTTP/1.1" status: 200  len: 1094 time: 1.1391120
Jun 01 10:11:36.590191 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3d232d55-724b-4a23-aa21-e4bdea0e204a', 'tag': '9206018f-e096-4bbf-be0f-57a111993b66'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:11:36.592459 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f3a2549b-75b6-431c-a277-e5616ef53b4a" -d '{"events": [{"name": "network-changed", "server_uuid": "3d232d55-724b-4a23-aa21-e4bdea0e204a", "tag": "9206018f-e096-4bbf-be0f-57a111993b66"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:11:36.613652 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Pushing event updated for resources: {'Port': ['ID=9206018f-e096-4bbf-be0f-57a111993b66,revision_number=3']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:36.617232 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:36.654371 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:11:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-151483f3-f717-4655-814c-a938f96870f6 x-openstack-request-id: req-151483f3-f717-4655-814c-a938f96870f6 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:11:36.654371 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3d232d55-724b-4a23-aa21-e4bdea0e204a", "tag": "9206018f-e096-4bbf-be0f-57a111993b66", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:11:36.654371 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-151483f3-f717-4655-814c-a938f96870f6 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:11:36.654371 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3d232d55-724b-4a23-aa21-e4bdea0e204a', 'tag': '9206018f-e096-4bbf-be0f-57a111993b66', 'status': 'completed', 'code': 200}
Jun 01 10:11:36.821805 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3a2549b-75b6-431c-a277-e5616ef53b4a req-58e2fb9a-51ae-4c5c-b581-65f96c2c28c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:36.823288 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f3a2549b-75b6-431c-a277-e5616ef53b4a req-58e2fb9a-51ae-4c5c-b581-65f96c2c28c7 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=d13dc1de700d428a8982ca87f11948d0&device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 1097 time: 0.1484637
Jun 01 10:11:36.964536 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3a2549b-75b6-431c-a277-e5616ef53b4a req-2b56b16f-d40e-47a3-a699-5713ddbcafbd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:36.966288 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f3a2549b-75b6-431c-a277-e5616ef53b4a req-2b56b16f-d40e-47a3-a699-5713ddbcafbd service neutron] 10.222.0.30 "GET /v2.0/networks?tenant_id=d13dc1de700d428a8982ca87f11948d0&shared=False HTTP/1.1" status: 200  len: 911 time: 0.1354558
Jun 01 10:11:37.114494 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3a2549b-75b6-431c-a277-e5616ef53b4a req-5afc39de-44a6-4936-ab44-817233847d75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:37.115951 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f3a2549b-75b6-431c-a277-e5616ef53b4a req-5afc39de-44a6-4936-ab44-817233847d75 service neutron] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1410170
Jun 01 10:11:37.287824 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2377001f-0a1b-41bb-9df7-9310a7af9137 req-c3943a3e-6370-4281-9b46-168bd757d4a7 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:37.289206 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2377001f-0a1b-41bb-9df7-9310a7af9137 req-c3943a3e-6370-4281-9b46-168bd757d4a7 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 945 time: 0.1390872
Jun 01 10:11:37.291959 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3927048f-a425-4e56-a56b-0cf63163a631 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:37.293280 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-3927048f-a425-4e56-a56b-0cf63163a631 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=d13dc1de700d428a8982ca87f11948d0&device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 1097 time: 0.1120558
Jun 01 10:11:37.382965 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-bee43825-5960-451e-bf19-bf0810e396e3 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9206018f-e096-4bbf-be0f-57a111993b66 HTTP/1.1" status: 200  len: 217 time: 0.0750945
Jun 01 10:11:37.428231 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2377001f-0a1b-41bb-9df7-9310a7af9137 req-754f07d6-dfdc-45e9-88fe-c101289ed817 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1331222
Jun 01 10:11:37.436642 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 541527f1-71e0-499b-8967-92c50bd692ae up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:11:37.459145 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-44ed3efd-c2e0-464e-86be-1d679eaaa28b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:37.460577 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-44ed3efd-c2e0-464e-86be-1d679eaaa28b service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2a00a573-a4bb-4d2d-a3e6-7aef03966618 HTTP/1.1" status: 200  len: 849 time: 0.0697727
Jun 01 10:11:37.543819 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-f66c6763-e3cc-4fa6-a45f-aa318ed7da4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:37.545233 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-f66c6763-e3cc-4fa6-a45f-aa318ed7da4f service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=3d9ff4d3-b145-4108-a593-976a9cfb63dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0775707
Jun 01 10:11:37.600100 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port 541527f1-71e0-499b-8967-92c50bd692ae completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:11:37.605955 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port 541527f1-71e0-499b-8967-92c50bd692ae triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:11:37.611293 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:37.736002 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-17425221-fccf-4f9f-b866-0191d6cda9bd service neutron] 10.222.0.30 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1833112
Jun 01 10:11:37.757862 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:37.783007 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c86ddfb4-8157-4e86-a53d-f615a1c10789 req-8f589629-dbc1-412a-b73a-d1326c5d60ab tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:37.784460 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c86ddfb4-8157-4e86-a53d-f615a1c10789 req-8f589629-dbc1-412a-b73a-d1326c5d60ab tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 944 time: 0.1465862
Jun 01 10:11:37.880153 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '541527f1-71e0-499b-8967-92c50bd692ae'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:11:37.882283 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a0806b63-5c04-4a52-b84d-8bc6f9bad9c8" -d '{"events": [{"server_uuid": "c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf", "name": "network-vif-plugged", "status": "completed", "tag": "541527f1-71e0-499b-8967-92c50bd692ae"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:11:37.900976 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 541527f1-71e0-499b-8967-92c50bd692ae, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=541527f1-71e0-499b-8967-92c50bd692ae,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:37.903523 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c86ddfb4-8157-4e86-a53d-f615a1c10789 req-c1b9a140-bf9f-4494-b69c-59823562135b tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=0500c211-3c38-4c74-b22c-0c81d01aa31a&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0704372
Jun 01 10:11:37.932764 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6961cde3-b198-4c61-bfb4-60387c2d12cd req-9951d3b1-34dd-41c4-9cb2-2f64f51d6d79 service neutron] 10.222.0.30 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1758242
Jun 01 10:11:37.978748 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:11:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f9ed3d54-d685-4370-a52e-9d0f0caad831 x-openstack-request-id: req-f9ed3d54-d685-4370-a52e-9d0f0caad831 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:11:37.979076 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf", "name": "network-vif-plugged", "status": "completed", "tag": "541527f1-71e0-499b-8967-92c50bd692ae", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:11:37.979608 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-f9ed3d54-d685-4370-a52e-9d0f0caad831 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:11:37.979758 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '541527f1-71e0-499b-8967-92c50bd692ae', 'code': 200}
Jun 01 10:11:37.987710 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:37.991980 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-c1a5ece1-8767-49f2-b112-fd84e232645b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:38.081907 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=541527f1-71e0-499b-8967-92c50bd692ae,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:38.085942 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:38.306820 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fa5bded-a862-4269-9f69-64df54a43f7b req-6dc1926c-92b1-473f-8db1-04018d87a696 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:38.308317 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6fa5bded-a862-4269-9f69-64df54a43f7b req-6dc1926c-92b1-473f-8db1-04018d87a696 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 1099 time: 0.0746076
Jun 01 10:11:38.351314 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6fa5bded-a862-4269-9f69-64df54a43f7b req-40b6048e-dc18-4304-a583-f1e4e3987881 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0340686
Jun 01 10:11:38.612529 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a421b5b-4579-4e92-bcb8-987911581988 req-da9e47b1-15da-4496-9153-c9464c01220f tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:38.614138 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6a421b5b-4579-4e92-bcb8-987911581988 req-da9e47b1-15da-4496-9153-c9464c01220f tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 946 time: 0.0781181
Jun 01 10:11:38.662553 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6a421b5b-4579-4e92-bcb8-987911581988 req-6984a3b2-9611-45ae-a682-dc0a526e1eec tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425601
Jun 01 10:11:39.096822 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b497ffb8-218c-4b11-8058-befd877b8756 req-593c321f-4138-4fe3-9175-bfb3179ade2c tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:39.098274 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b497ffb8-218c-4b11-8058-befd877b8756 req-593c321f-4138-4fe3-9175-bfb3179ade2c tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 944 time: 0.0786874
Jun 01 10:11:39.142866 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b497ffb8-218c-4b11-8058-befd877b8756 req-bbc39e46-a9e0-49e9-9ea5-da79f02e1c24 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=0500c211-3c38-4c74-b22c-0c81d01aa31a&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0388286
Jun 01 10:11:39.853349 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-243b9be5-00e9-49ed-abab-df0003b049eb req-eae0e9e7-701a-4b18-9b93-4c6cda0634b1 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:39.854701 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-243b9be5-00e9-49ed-abab-df0003b049eb req-eae0e9e7-701a-4b18-9b93-4c6cda0634b1 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 946 time: 0.0840871
Jun 01 10:11:39.899720 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-243b9be5-00e9-49ed-abab-df0003b049eb req-86d82793-f3dd-4532-9735-d472a419a193 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387557
Jun 01 10:11:40.331652 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fde0715-4631-4aba-a2d7-155445b7850c req-0761b66e-e0ca-42d3-a7f2-71158353eec3 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:40.333337 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9fde0715-4631-4aba-a2d7-155445b7850c req-0761b66e-e0ca-42d3-a7f2-71158353eec3 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 944 time: 0.0847223
Jun 01 10:11:40.380469 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9fde0715-4631-4aba-a2d7-155445b7850c req-8d45d0c1-7d5e-49af-8c3b-d0622ecd4b9e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=0500c211-3c38-4c74-b22c-0c81d01aa31a&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0409455
Jun 01 10:11:40.500044 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-9e961fa6-caff-4577-9239-cfd60cadc010 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:41.434677 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 9206018f-e096-4bbf-be0f-57a111993b66 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:11:41.576594 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 9206018f-e096-4bbf-be0f-57a111993b66, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=9206018f-e096-4bbf-be0f-57a111993b66,segment=NetworkSegment(2f350557-5423-4a12-a64b-0bf55f2578e6),segment_id=2f350557-5423-4a12-a64b-0bf55f2578e6)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:41.592011 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': '9206018f-e096-4bbf-be0f-57a111993b66', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'port_id': '9206018f-e096-4bbf-be0f-57a111993b66', 'mac_address': 'fa:16:3e:a4:6e:d6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 860, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:11:41.657402 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:41.676798 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9206018f-e096-4bbf-be0f-57a111993b66 {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:11:41.689546 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db9d70fb-3b3d-4710-987e-97547b58c8c0 req-80d43695-2c85-4e3a-8194-76f0056a5f97 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:41.692042 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-db9d70fb-3b3d-4710-987e-97547b58c8c0 req-80d43695-2c85-4e3a-8194-76f0056a5f97 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 944 time: 0.1980519
Jun 01 10:11:41.694867 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 9206018f-e096-4bbf-be0f-57a111993b66, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=9206018f-e096-4bbf-be0f-57a111993b66,segment=NetworkSegment(2f350557-5423-4a12-a64b-0bf55f2578e6),segment_id=2f350557-5423-4a12-a64b-0bf55f2578e6)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:41.739301 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-db9d70fb-3b3d-4710-987e-97547b58c8c0 req-0e4f22b6-b2db-4ec1-b9e2-65ba0571d34e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=0500c211-3c38-4c74-b22c-0c81d01aa31a&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0419307
Jun 01 10:11:41.809547 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:41.811776 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:41.880583 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=9206018f-e096-4bbf-be0f-57a111993b66,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:41.883893 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:42.154204 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['9206018f-e096-4bbf-be0f-57a111993b66'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:11:42.281397 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bffd436d-dd1f-4601-8bde-d741e789b24d req-2e802536-28e7-4d4f-a2bc-d6c0375cc543 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:42.282997 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bffd436d-dd1f-4601-8bde-d741e789b24d req-2e802536-28e7-4d4f-a2bc-d6c0375cc543 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 945 time: 0.0837517
Jun 01 10:11:42.338381 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bffd436d-dd1f-4601-8bde-d741e789b24d req-42d1b1e8-a892-4d2c-9ab3-8efb33fe5149 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0491283
Jun 01 10:11:42.934638 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76711adf-840e-4a4d-9930-18b1507638f6 req-5862f801-976b-47e2-8cfd-e83eb6e5975d tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:42.936125 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-76711adf-840e-4a4d-9930-18b1507638f6 req-5862f801-976b-47e2-8cfd-e83eb6e5975d tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 945 time: 0.0822754
Jun 01 10:11:42.952439 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-20f7f2b0-c5bc-4023-b2e2-0f896ea765a7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:42.983516 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-76711adf-840e-4a4d-9930-18b1507638f6 req-4d350713-c253-4845-b764-e4a07a4bf2d8 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=0500c211-3c38-4c74-b22c-0c81d01aa31a&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0412436
Jun 01 10:11:43.251436 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:43.450425 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 9206018f-e096-4bbf-be0f-57a111993b66 up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:11:43.533259 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbd68ddb-a60e-42c9-a4cf-8393251f9a60 req-7424c0ab-bcc9-42ae-ad3d-292433c61270 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:43.534731 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dbd68ddb-a60e-42c9-a4cf-8393251f9a60 req-7424c0ab-bcc9-42ae-ad3d-292433c61270 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 945 time: 0.0907416
Jun 01 10:11:43.581115 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-dbd68ddb-a60e-42c9-a4cf-8393251f9a60 req-2314d5ce-f075-4aee-857d-767586a9c969 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403588
Jun 01 10:11:43.611198 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port 9206018f-e096-4bbf-be0f-57a111993b66 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:11:43.616439 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port 9206018f-e096-4bbf-be0f-57a111993b66 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:11:43.616818 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:43.733797 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:43.761650 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3d232d55-724b-4a23-aa21-e4bdea0e204a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9206018f-e096-4bbf-be0f-57a111993b66'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:11:43.763911 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2c46e60b-4a0f-4fbf-8d2b-9cabf6ba9538" -d '{"events": [{"server_uuid": "3d232d55-724b-4a23-aa21-e4bdea0e204a", "name": "network-vif-plugged", "status": "completed", "tag": "9206018f-e096-4bbf-be0f-57a111993b66"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:11:43.771834 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 9206018f-e096-4bbf-be0f-57a111993b66, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=9206018f-e096-4bbf-be0f-57a111993b66,segment=NetworkSegment(2f350557-5423-4a12-a64b-0bf55f2578e6),segment_id=2f350557-5423-4a12-a64b-0bf55f2578e6)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:43.855347 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:11:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cdfa0803-b2b0-4b3e-8c74-79b2d343e23c x-openstack-request-id: req-cdfa0803-b2b0-4b3e-8c74-79b2d343e23c {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:11:43.855641 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3d232d55-724b-4a23-aa21-e4bdea0e204a", "name": "network-vif-plugged", "status": "completed", "tag": "9206018f-e096-4bbf-be0f-57a111993b66", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:11:43.855942 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-cdfa0803-b2b0-4b3e-8c74-79b2d343e23c {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:11:43.856332 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3d232d55-724b-4a23-aa21-e4bdea0e204a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9206018f-e096-4bbf-be0f-57a111993b66', 'code': 200}
Jun 01 10:11:43.868704 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:43.871294 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:43.954816 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=9206018f-e096-4bbf-be0f-57a111993b66,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:43.957919 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:44.020841 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:44.175457 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f264f089-d9ac-4c01-835d-5ca7bd5c31ff req-123f1853-8f6b-4f21-912a-f75ad5c5ca3c tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:44.176820 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f264f089-d9ac-4c01-835d-5ca7bd5c31ff req-123f1853-8f6b-4f21-912a-f75ad5c5ca3c tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 946 time: 0.0810823
Jun 01 10:11:44.269048 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f264f089-d9ac-4c01-835d-5ca7bd5c31ff req-c1cc9169-da26-43ad-9ff2-b3265d9d9469 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=0500c211-3c38-4c74-b22c-0c81d01aa31a&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0573597
Jun 01 10:11:44.283514 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a27f4d-08a6-4905-80ad-6d0bfbb8a508 req-61aca725-d782-4e8c-8b1e-35e0b52135c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:44.284957 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d8a27f4d-08a6-4905-80ad-6d0bfbb8a508 req-61aca725-d782-4e8c-8b1e-35e0b52135c5 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 1099 time: 0.1073020
Jun 01 10:11:44.329126 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d8a27f4d-08a6-4905-80ad-6d0bfbb8a508 req-a91f3892-ad5f-4f13-8631-0ae986eef460 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=0500c211-3c38-4c74-b22c-0c81d01aa31a&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0354061
Jun 01 10:11:44.369500 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bf3483b-15b3-42c7-9431-ae68754fe645 req-ecae9f6c-62af-4b04-811c-d23877cdf724 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:44.370239 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-0bf3483b-15b3-42c7-9431-ae68754fe645 req-ecae9f6c-62af-4b04-811c-d23877cdf724 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Synchronizing usage tracker for tenant:80c0fea786fd4fb9afd054ddb2559c2a on resource:port {{(pid=92565) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:11:44.382545 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-0bf3483b-15b3-42c7-9431-ae68754fe645 req-ecae9f6c-62af-4b04-811c-d23877cdf724 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Unset dirty status for tenant:80c0fea786fd4fb9afd054ddb2559c2a on resource:port {{(pid=92565) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:11:44.383658 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-0bf3483b-15b3-42c7-9431-ae68754fe645 req-ecae9f6c-62af-4b04-811c-d23877cdf724 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.30 "GET /v2.0/ports?device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 945 time: 0.1076319
Jun 01 10:11:44.523825 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [req-0bf3483b-15b3-42c7-9431-ae68754fe645 req-dd901936-54a7-4b37-b286-df8318b24fba tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Deleting port c8b555e7-d683-4993-8750-7d3bfbdc6b8b {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:11:44.524080 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-0bf3483b-15b3-42c7-9431-ae68754fe645 req-dd901936-54a7-4b37-b286-df8318b24fba tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:44.658818 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-0bf3483b-15b3-42c7-9431-ae68754fe645 req-dd901936-54a7-4b37-b286-df8318b24fba tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] For port c8b555e7-d683-4993-8750-7d3bfbdc6b8b, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c8b555e7-d683-4993-8750-7d3bfbdc6b8b,segment=NetworkSegment(f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793),segment_id=f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:44.659319 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-0bf3483b-15b3-42c7-9431-ae68754fe645 req-dd901936-54a7-4b37-b286-df8318b24fba tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:44.774760 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85982cc3-f9b9-4705-a211-31f503e39065 req-281525b3-8dfe-4643-b5df-b8c4751f2062 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:44.776212 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-85982cc3-f9b9-4705-a211-31f503e39065 req-281525b3-8dfe-4643-b5df-b8c4751f2062 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 945 time: 0.0858073
Jun 01 10:11:44.824166 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-85982cc3-f9b9-4705-a211-31f503e39065 req-1a0cc2e5-0390-4949-8043-9dcae1c957bf tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/security-groups?id=7940912d-cf3a-47b8-92ad-b536ac1d0a04&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422456
Jun 01 10:11:44.874478 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [req-0bf3483b-15b3-42c7-9431-ae68754fe645 req-dd901936-54a7-4b37-b286-df8318b24fba tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Calling delete_port for c8b555e7-d683-4993-8750-7d3bfbdc6b8b owned by compute:nova {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:11:45.039782 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-0bf3483b-15b3-42c7-9431-ae68754fe645 req-dd901936-54a7-4b37-b286-df8318b24fba tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:45.046451 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:11:45.053738 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['c8b555e7-d683-4993-8750-7d3bfbdc6b8b'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:11:45.097697 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd901936-54a7-4b37-b286-df8318b24fba tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Pushing event deleted for resources: {'Port': ['ID=c8b555e7-d683-4993-8750-7d3bfbdc6b8b,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:11:45.100234 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-dd901936-54a7-4b37-b286-df8318b24fba tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:11:45.172127 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [req-0bf3483b-15b3-42c7-9431-ae68754fe645 req-dd901936-54a7-4b37-b286-df8318b24fba tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] No DVR routers for this DVR port c8b555e7-d683-4993-8750-7d3bfbdc6b8b on host hv-cinder-78726 {{(pid=92565) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:11:45.175102 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-0bf3483b-15b3-42c7-9431-ae68754fe645 req-dd901936-54a7-4b37-b286-df8318b24fba tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:45.177563 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '72a67d95-dbba-41d6-a26f-15844e8b9415', 'name': 'network-vif-deleted', 'tag': 'c8b555e7-d683-4993-8750-7d3bfbdc6b8b'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:11:45.179831 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8b0ce88c-c348-44a4-b7a7-e5c9b8577815" -d '{"events": [{"server_uuid": "72a67d95-dbba-41d6-a26f-15844e8b9415", "name": "network-vif-deleted", "tag": "c8b555e7-d683-4993-8750-7d3bfbdc6b8b"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:11:45.235353 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-0bf3483b-15b3-42c7-9431-ae68754fe645 req-dd901936-54a7-4b37-b286-df8318b24fba tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.30 "DELETE /v2.0/ports/c8b555e7-d683-4993-8750-7d3bfbdc6b8b HTTP/1.1" status: 204  len: 173 time: 0.8417840
Jun 01 10:11:45.284637 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:11:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6d04532c-9b5f-48ac-887c-1d75c19e71a7 x-openstack-request-id: req-6d04532c-9b5f-48ac-887c-1d75c19e71a7 {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:11:45.285010 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "72a67d95-dbba-41d6-a26f-15844e8b9415", "name": "network-vif-deleted", "tag": "c8b555e7-d683-4993-8750-7d3bfbdc6b8b", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:11:45.285248 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-6d04532c-9b5f-48ac-887c-1d75c19e71a7 {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:11:45.285675 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '72a67d95-dbba-41d6-a26f-15844e8b9415', 'name': 'network-vif-deleted', 'tag': 'c8b555e7-d683-4993-8750-7d3bfbdc6b8b', 'status': 'completed', 'code': 200}
Jun 01 10:11:45.456641 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0baa354-061c-4b0b-9cae-5d76cdc7724c req-54446e9a-e221-4a74-9705-0275f3a940c4 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:45.458108 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f0baa354-061c-4b0b-9cae-5d76cdc7724c req-54446e9a-e221-4a74-9705-0275f3a940c4 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 946 time: 0.0830905
Jun 01 10:11:45.507494 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f0baa354-061c-4b0b-9cae-5d76cdc7724c req-e79ce6be-9fcf-4c62-b0fa-361f43f85d96 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=0500c211-3c38-4c74-b22c-0c81d01aa31a&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0432808
Jun 01 10:11:45.771051 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:45.991597 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-68e3293f-7fc2-4110-b6a9-912fab0765bb req-4131854a-74dc-45b3-850a-8fff525b45a0 tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] 10.222.0.68 "GET /v2.0/ports?device_id=72a67d95-dbba-41d6-a26f-15844e8b9415 HTTP/1.1" status: 200  len: 210 time: 0.0477211
Jun 01 10:11:46.691256 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64736556-d4ae-4a5b-9523-f43a382ad9b9 req-0915ec26-dc5a-4e53-bce7-3124f89bec2c tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:46.692670 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-64736556-d4ae-4a5b-9523-f43a382ad9b9 req-0915ec26-dc5a-4e53-bce7-3124f89bec2c tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 946 time: 0.0773842
Jun 01 10:11:46.736441 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-64736556-d4ae-4a5b-9523-f43a382ad9b9 req-1a8c1f57-4616-4006-840d-d48c86a94496 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=0500c211-3c38-4c74-b22c-0c81d01aa31a&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0381038
Jun 01 10:11:46.918723 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b5ea95c-29cb-41dc-a84d-aee92321fabc req-4f9a6b05-83ac-4857-ab38-78fc29ff13c0 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:46.920208 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6b5ea95c-29cb-41dc-a84d-aee92321fabc req-4f9a6b05-83ac-4857-ab38-78fc29ff13c0 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 946 time: 0.0842969
Jun 01 10:11:46.928876 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 35956) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:11:46.934088 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-b660f63d-0865-4a87-8997-0d3b60142686 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Request body: {'floatingip': {'port_id': '9206018f-e096-4bbf-be0f-57a111993b66'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:11:47.013237 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b660f63d-0865-4a87-8997-0d3b60142686 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for floatingip, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:47.607034 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b660f63d-0865-4a87-8997-0d3b60142686 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:47.661065 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b660f63d-0865-4a87-8997-0d3b60142686 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:47.835633 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.l3_db [None req-b660f63d-0865-4a87-8997-0d3b60142686 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Floating IP 80b14f4c-e062-4b26-9907-90fc498878e2 associated. External IP: 172.27.2.112, port: 9206018f-e096-4bbf-be0f-57a111993b66.
Jun 01 10:11:48.292851 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b660f63d-0865-4a87-8997-0d3b60142686 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Router d0653611-f9db-4b67-b4b2-4c0789fb691f has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:11:48.476848 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b660f63d-0865-4a87-8997-0d3b60142686 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:11:48.483332 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b660f63d-0865-4a87-8997-0d3b60142686 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:48.486660 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aea608a1-c979-4c63-a8af-ea019d2eaf28 None None] Sync routers for ids ['d0653611-f9db-4b67-b4b2-4c0789fb691f'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:11:48.496608 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aea608a1-c979-4c63-a8af-ea019d2eaf28 None None] Routers {'d0653611-f9db-4b67-b4b2-4c0789fb691f'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:11:48.497213 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-aea608a1-c979-4c63-a8af-ea019d2eaf28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72be53a0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:11:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d0653611-f9db-4b67-b4b2-4c0789fb691f'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:11:48.540773 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-b660f63d-0865-4a87-8997-0d3b60142686 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "PUT /v2.0/floatingips/80b14f4c-e062-4b26-9907-90fc498878e2 HTTP/1.1" status: 200  len: 992 time: 1.6105807
Jun 01 10:11:48.541383 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3d232d55-724b-4a23-aa21-e4bdea0e204a', 'tag': '9206018f-e096-4bbf-be0f-57a111993b66'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:11:48.545562 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3afe25a9-937c-480f-b912-0e759df231d7" -d '{"events": [{"name": "network-changed", "server_uuid": "3d232d55-724b-4a23-aa21-e4bdea0e204a", "tag": "9206018f-e096-4bbf-be0f-57a111993b66"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:11:48.591246 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:11:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1e1c1660-8f39-40cf-946e-1c4b97f1594c x-openstack-request-id: req-1e1c1660-8f39-40cf-946e-1c4b97f1594c {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:11:48.591580 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3d232d55-724b-4a23-aa21-e4bdea0e204a", "tag": "9206018f-e096-4bbf-be0f-57a111993b66", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:11:48.592049 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-1e1c1660-8f39-40cf-946e-1c4b97f1594c {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:11:48.592488 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3d232d55-724b-4a23-aa21-e4bdea0e204a', 'tag': '9206018f-e096-4bbf-be0f-57a111993b66', 'status': 'completed', 'code': 200}
Jun 01 10:11:48.685027 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-aea608a1-c979-4c63-a8af-ea019d2eaf28 None None] Set router d0653611-f9db-4b67-b4b2-4c0789fb691f gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:11:48.686054 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3afe25a9-937c-480f-b912-0e759df231d7 req-07ee03d7-34f5-4f5b-af53-85a4716a96d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:48.687580 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-3afe25a9-937c-480f-b912-0e759df231d7 req-07ee03d7-34f5-4f5b-af53-85a4716a96d6 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=d13dc1de700d428a8982ca87f11948d0&device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 1099 time: 0.0729351
Jun 01 10:11:48.830726 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3afe25a9-937c-480f-b912-0e759df231d7 req-dee8df53-4690-4fb9-a54b-2bcdab720771 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:48.832370 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-3afe25a9-937c-480f-b912-0e759df231d7 req-dee8df53-4690-4fb9-a54b-2bcdab720771 service neutron] 10.222.0.30 "GET /v2.0/networks?id=3d9ff4d3-b145-4108-a593-976a9cfb63dc HTTP/1.1" status: 200  len: 911 time: 0.1367207
Jun 01 10:11:48.953349 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-3afe25a9-937c-480f-b912-0e759df231d7 req-180c6ea6-e1ec-4ece-bf71-aa2060091892 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9206018f-e096-4bbf-be0f-57a111993b66 HTTP/1.1" status: 200  len: 1000 time: 0.1075358
Jun 01 10:11:49.032060 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3afe25a9-937c-480f-b912-0e759df231d7 req-306dd31a-ebe6-4d70-a25e-bcb436ef2e42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:49.033675 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-3afe25a9-937c-480f-b912-0e759df231d7 req-306dd31a-ebe6-4d70-a25e-bcb436ef2e42 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=2a00a573-a4bb-4d2d-a3e6-7aef03966618 HTTP/1.1" status: 200  len: 849 time: 0.0622010
Jun 01 10:11:49.082819 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-aea608a1-c979-4c63-a8af-ea019d2eaf28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72be53a0>, [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:10Z', 'revision_number': 4, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '80b14f4c-e062-4b26-9907-90fc498878e2', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'floating_ip_address': '172.27.2.112', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'port_id': '9206018f-e096-4bbf-be0f-57a111993b66', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 441, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'mac_address': 'fa:16:3e:a4:6e:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d232d55-724b-4a23-aa21-e4bdea0e204a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:11:24Z', 'updated_at': '2021-06-01T10:11:47Z', 'revision_number': 1, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71', 'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'mac_address': 'fa:16:3e:a9:83:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:23Z', 'revision_number': 5, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'subnets': [{'id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:11:49.086597 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aea608a1-c979-4c63-a8af-ea019d2eaf28 None None] Checking router: d0653611-f9db-4b67-b4b2-4c0789fb691f for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:11:49.094983 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aea608a1-c979-4c63-a8af-ea019d2eaf28 None None] Routers {'d0653611-f9db-4b67-b4b2-4c0789fb691f'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:11:49.095661 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-aea608a1-c979-4c63-a8af-ea019d2eaf28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72be53a0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:11:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d0653611-f9db-4b67-b4b2-4c0789fb691f'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:11:49.115193 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3afe25a9-937c-480f-b912-0e759df231d7 req-3a239d1f-c31d-4eb6-b018-0d07cabe4525 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:49.116696 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-3afe25a9-937c-480f-b912-0e759df231d7 req-3a239d1f-c31d-4eb6-b018-0d07cabe4525 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=3d9ff4d3-b145-4108-a593-976a9cfb63dc&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0749331
Jun 01 10:11:49.276342 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-3afe25a9-937c-480f-b912-0e759df231d7 req-5e3a1395-7827-4604-9b5c-b1dfdd1bbeb6 service neutron] 10.222.0.30 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1348610
Jun 01 10:11:49.276498 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-aea608a1-c979-4c63-a8af-ea019d2eaf28 None None] Set router d0653611-f9db-4b67-b4b2-4c0789fb691f gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:11:49.419236 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-3afe25a9-937c-480f-b912-0e759df231d7 req-85da310f-439a-48b5-b49d-b169d4d2cf2c service neutron] 10.222.0.30 "GET /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1350842
Jun 01 10:11:49.471447 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:11:49.513549 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device c8b555e7-d683-4993-8750-7d3bfbdc6b8b no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:11:49.561711 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: c8b555e7-d683-4993-8750-7d3bfbdc6b8b {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:11:49.562055 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device c8b555e7-d683-4993-8750-7d3bfbdc6b8b not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:11:49.670604 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-aea608a1-c979-4c63-a8af-ea019d2eaf28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72be53a0>, [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:10Z', 'revision_number': 4, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '80b14f4c-e062-4b26-9907-90fc498878e2', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'floating_ip_address': '172.27.2.112', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'port_id': '9206018f-e096-4bbf-be0f-57a111993b66', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 441, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'mac_address': 'fa:16:3e:a4:6e:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d232d55-724b-4a23-aa21-e4bdea0e204a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:11:24Z', 'updated_at': '2021-06-01T10:11:47Z', 'revision_number': 1, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71', 'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'mac_address': 'fa:16:3e:a9:83:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:23Z', 'revision_number': 5, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'subnets': [{'id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:11:49.674576 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aea608a1-c979-4c63-a8af-ea019d2eaf28 None None] The sync data for ids ['d0653611-f9db-4b67-b4b2-4c0789fb691f'] in dv-cinder-787262-4-iscsi is: [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:10Z', 'revision_number': 4, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '80b14f4c-e062-4b26-9907-90fc498878e2', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'floating_ip_address': '172.27.2.112', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'port_id': '9206018f-e096-4bbf-be0f-57a111993b66', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 441, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'mac_address': 'fa:16:3e:a4:6e:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d232d55-724b-4a23-aa21-e4bdea0e204a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:11:24Z', 'updated_at': '2021-06-01T10:11:47Z', 'revision_number': 1, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71', 'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'mac_address': 'fa:16:3e:a9:83:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:23Z', 'revision_number': 5, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'subnets': [{'id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:11:49.865214 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2118049b-f45f-4e1a-8523-fd19df5902cf None None] New status for floating IP 80b14f4c-e062-4b26-9907-90fc498878e2: ACTIVE {{(pid=92568) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:11:56.518258 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:57.804702 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c92be63-15b2-4757-b01f-028c91329f30 req-df558d3b-14ca-49ac-ae11-f9963c819629 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:57.806142 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8c92be63-15b2-4757-b01f-028c91329f30 req-df558d3b-14ca-49ac-ae11-f9963c819629 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 946 time: 0.0819111
Jun 01 10:11:57.849871 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8c92be63-15b2-4757-b01f-028c91329f30 req-96e2fd13-4e8c-4f55-a3ad-6a833480ae25 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0378687
Jun 01 10:11:59.040090 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5b1573-5d24-4801-ae94-e03c028d7948 req-20b75bfe-0d76-4f19-b421-101921382435 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:59.041620 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2e5b1573-5d24-4801-ae94-e03c028d7948 req-20b75bfe-0d76-4f19-b421-101921382435 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 946 time: 0.0830972
Jun 01 10:11:59.087704 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2e5b1573-5d24-4801-ae94-e03c028d7948 req-e080f252-4714-4d83-bc74-adb1bca69b05 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398903
Jun 01 10:11:59.541018 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-140db467-5153-4674-b11c-78a0fced5033 req-3c895826-2be1-4180-8c31-88f579fc87ca tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:11:59.542499 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-140db467-5153-4674-b11c-78a0fced5033 req-3c895826-2be1-4180-8c31-88f579fc87ca tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.30 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 946 time: 0.0871212
Jun 01 10:11:59.681939 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [req-140db467-5153-4674-b11c-78a0fced5033 req-fd615c5f-2234-4e92-9745-6480eda2d801 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Deleting port 541527f1-71e0-499b-8967-92c50bd692ae {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:11:59.682280 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-140db467-5153-4674-b11c-78a0fced5033 req-fd615c5f-2234-4e92-9745-6480eda2d801 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:11:59.909349 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-140db467-5153-4674-b11c-78a0fced5033 req-fd615c5f-2234-4e92-9745-6480eda2d801 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] For port 541527f1-71e0-499b-8967-92c50bd692ae, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=541527f1-71e0-499b-8967-92c50bd692ae,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:11:59.909729 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-140db467-5153-4674-b11c-78a0fced5033 req-fd615c5f-2234-4e92-9745-6480eda2d801 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:00.034613 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [req-140db467-5153-4674-b11c-78a0fced5033 req-fd615c5f-2234-4e92-9745-6480eda2d801 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Calling delete_port for 541527f1-71e0-499b-8967-92c50bd692ae owned by compute:nova {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:12:00.216529 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-140db467-5153-4674-b11c-78a0fced5033 req-fd615c5f-2234-4e92-9745-6480eda2d801 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:00.230055 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:00.239905 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b9a603f6-29ce-4e91-834d-bbc141a71b42 req-72746d96-7c26-43ca-b2fd-3a1c6f2778d4 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 210 time: 0.0430355
Jun 01 10:12:00.278481 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd615c5f-2234-4e92-9745-6480eda2d801 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Pushing event deleted for resources: {'Port': ['ID=541527f1-71e0-499b-8967-92c50bd692ae,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:00.305347 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-fd615c5f-2234-4e92-9745-6480eda2d801 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:00.349996 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [req-140db467-5153-4674-b11c-78a0fced5033 req-fd615c5f-2234-4e92-9745-6480eda2d801 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] No DVR routers for this DVR port 541527f1-71e0-499b-8967-92c50bd692ae on host hv-cinder-78726 {{(pid=92565) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:12:00.352421 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-140db467-5153-4674-b11c-78a0fced5033 req-fd615c5f-2234-4e92-9745-6480eda2d801 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:00.354854 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf', 'name': 'network-vif-deleted', 'tag': '541527f1-71e0-499b-8967-92c50bd692ae'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:12:00.357106 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c868e1c8-b134-4d39-a906-27d667b89cf8" -d '{"events": [{"server_uuid": "c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf", "name": "network-vif-deleted", "tag": "541527f1-71e0-499b-8967-92c50bd692ae"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:12:00.400043 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:12:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3e8210b6-2d25-420d-9920-75dbb72d2d18 x-openstack-request-id: req-3e8210b6-2d25-420d-9920-75dbb72d2d18 {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:12:00.403173 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf", "name": "network-vif-deleted", "tag": "541527f1-71e0-499b-8967-92c50bd692ae", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:12:00.403173 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-3e8210b6-2d25-420d-9920-75dbb72d2d18 {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:12:00.403173 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf', 'name': 'network-vif-deleted', 'tag': '541527f1-71e0-499b-8967-92c50bd692ae', 'status': 'completed', 'code': 200}
Jun 01 10:12:00.423158 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-140db467-5153-4674-b11c-78a0fced5033 req-fd615c5f-2234-4e92-9745-6480eda2d801 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.30 "DELETE /v2.0/ports/541527f1-71e0-499b-8967-92c50bd692ae HTTP/1.1" status: 204  len: 173 time: 0.8693523
Jun 01 10:12:02.697161 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['6010d8c0-403f-4393-8c5c-fd9cc14aeecb', '41cda8ce-e474-41cf-9b05-6c4a119eed48', 'c6da8fab-3cf3-43a2-aff8-b6f43e149b0a', '541527f1-71e0-499b-8967-92c50bd692ae'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:12:02.862395 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-697c3b6f-903d-42f9-9fb4-c080abdff726 req-963b94e4-4679-470a-a796-63a877b3ab98 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=c9aa8908-eaf8-4e4a-ad68-ccb8da287bcf HTTP/1.1" status: 200  len: 210 time: 0.0634971
Jun 01 10:12:04.725752 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 541527f1-71e0-499b-8967-92c50bd692ae no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:12:04.761745 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: 541527f1-71e0-499b-8967-92c50bd692ae {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:12:04.762099 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 541527f1-71e0-499b-8967-92c50bd692ae not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:12:06.354657 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28d3271d-b571-414c-b819-554560e1c5ec req-721cf729-38cd-44fe-95cf-6a8ad8072577 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:06.356047 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-28d3271d-b571-414c-b819-554560e1c5ec req-721cf729-38cd-44fe-95cf-6a8ad8072577 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 946 time: 0.0840960
Jun 01 10:12:06.400513 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-28d3271d-b571-414c-b819-554560e1c5ec req-08cd473b-bded-4dcf-bc2e-9699c418a213 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387390
Jun 01 10:12:06.706615 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4540b39a-80df-4451-9e3c-832fde783d57 req-ca2d6155-d233-4c79-9333-ea20ea50958b tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:06.708701 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4540b39a-80df-4451-9e3c-832fde783d57 req-ca2d6155-d233-4c79-9333-ea20ea50958b tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.0828297
Jun 01 10:12:06.756799 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4540b39a-80df-4451-9e3c-832fde783d57 req-00437fcd-3b8b-4f2a-9e82-e36bbc139f8f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0425546
Jun 01 10:12:07.584810 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f728de2-ffbd-431e-bf30-6140bbdff6c6 req-aba31be0-b574-4142-a175-4ba328e47ee8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:07.586194 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6f728de2-ffbd-431e-bf30-6140bbdff6c6 req-aba31be0-b574-4142-a175-4ba328e47ee8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 946 time: 0.0827796
Jun 01 10:12:07.630306 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6f728de2-ffbd-431e-bf30-6140bbdff6c6 req-2667a3e8-4a75-48e4-b881-8a39594ac974 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0385075
Jun 01 10:12:07.924427 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91d94189-1638-4409-a45e-37559b784fda req-0d86db7b-37aa-4fa4-88fa-087fb71d6cea tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:07.925069 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-91d94189-1638-4409-a45e-37559b784fda req-0d86db7b-37aa-4fa4-88fa-087fb71d6cea tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Synchronizing usage tracker for tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe on resource:port {{(pid=92565) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:12:07.951265 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-086ad5e7-869c-4f0d-8e34-2a0644ce1da8 req-a2be203c-b19b-4593-b148-f28a64061c22 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:07.952776 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-086ad5e7-869c-4f0d-8e34-2a0644ce1da8 req-a2be203c-b19b-4593-b148-f28a64061c22 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.0866978
Jun 01 10:12:07.998401 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-086ad5e7-869c-4f0d-8e34-2a0644ce1da8 req-edea885c-c719-44ea-a781-f478ce38b380 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0386543
Jun 01 10:12:08.096793 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-91d94189-1638-4409-a45e-37559b784fda req-0d86db7b-37aa-4fa4-88fa-087fb71d6cea tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Unset dirty status for tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe on resource:port {{(pid=92565) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:12:08.097987 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-91d94189-1638-4409-a45e-37559b784fda req-0d86db7b-37aa-4fa4-88fa-087fb71d6cea tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.30 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 946 time: 0.2589684
Jun 01 10:12:08.236848 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [req-91d94189-1638-4409-a45e-37559b784fda req-bfd4227b-fcff-4516-8cab-02c8edae6f48 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Deleting port c6da8fab-3cf3-43a2-aff8-b6f43e149b0a {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:12:08.237188 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-91d94189-1638-4409-a45e-37559b784fda req-bfd4227b-fcff-4516-8cab-02c8edae6f48 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:08.384181 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-91d94189-1638-4409-a45e-37559b784fda req-bfd4227b-fcff-4516-8cab-02c8edae6f48 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] For port c6da8fab-3cf3-43a2-aff8-b6f43e149b0a, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=c6da8fab-3cf3-43a2-aff8-b6f43e149b0a,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:12:08.384601 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-91d94189-1638-4409-a45e-37559b784fda req-bfd4227b-fcff-4516-8cab-02c8edae6f48 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:08.509835 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [req-91d94189-1638-4409-a45e-37559b784fda req-bfd4227b-fcff-4516-8cab-02c8edae6f48 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Calling delete_port for c6da8fab-3cf3-43a2-aff8-b6f43e149b0a owned by compute:nova {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:12:08.742511 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-91d94189-1638-4409-a45e-37559b784fda req-bfd4227b-fcff-4516-8cab-02c8edae6f48 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:08.752373 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:08.757943 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['6010d8c0-403f-4393-8c5c-fd9cc14aeecb', '41cda8ce-e474-41cf-9b05-6c4a119eed48', 'c6da8fab-3cf3-43a2-aff8-b6f43e149b0a'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:12:08.781675 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d787405c-9432-4496-843a-82aac16d1b88 req-65c5839e-4b6a-4bc5-9ee4-57d15d7af282 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 210 time: 0.0434446
Jun 01 10:12:08.799688 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfd4227b-fcff-4516-8cab-02c8edae6f48 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Pushing event deleted for resources: {'Port': ['ID=c6da8fab-3cf3-43a2-aff8-b6f43e149b0a,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:08.806657 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-bfd4227b-fcff-4516-8cab-02c8edae6f48 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:08.878732 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [req-91d94189-1638-4409-a45e-37559b784fda req-bfd4227b-fcff-4516-8cab-02c8edae6f48 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] No DVR routers for this DVR port c6da8fab-3cf3-43a2-aff8-b6f43e149b0a on host hv-cinder-78726 {{(pid=92565) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:12:08.881299 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-91d94189-1638-4409-a45e-37559b784fda req-bfd4227b-fcff-4516-8cab-02c8edae6f48 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:08.883887 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa', 'name': 'network-vif-deleted', 'tag': 'c6da8fab-3cf3-43a2-aff8-b6f43e149b0a'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:12:08.886128 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0cbfea74-7002-40ed-b1cd-fd30e94d15bf" -d '{"events": [{"server_uuid": "1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa", "name": "network-vif-deleted", "tag": "c6da8fab-3cf3-43a2-aff8-b6f43e149b0a"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:12:08.930524 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:12:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a9b2c60f-b950-4a00-a6b3-840f2eeb2834 x-openstack-request-id: req-a9b2c60f-b950-4a00-a6b3-840f2eeb2834 {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:12:08.931171 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa", "name": "network-vif-deleted", "tag": "c6da8fab-3cf3-43a2-aff8-b6f43e149b0a", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:12:08.931171 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-a9b2c60f-b950-4a00-a6b3-840f2eeb2834 {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:12:08.931778 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa', 'name': 'network-vif-deleted', 'tag': 'c6da8fab-3cf3-43a2-aff8-b6f43e149b0a', 'status': 'completed', 'code': 200}
Jun 01 10:12:08.989851 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-91d94189-1638-4409-a45e-37559b784fda req-bfd4227b-fcff-4516-8cab-02c8edae6f48 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.30 "DELETE /v2.0/ports/c6da8fab-3cf3-43a2-aff8-b6f43e149b0a HTTP/1.1" status: 204  len: 173 time: 0.8849361
Jun 01 10:12:09.209472 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca48e31a-3b9e-4435-b033-6d72925c7e9d req-b8345f47-e071-4498-b248-be33097ffc29 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:09.211033 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ca48e31a-3b9e-4435-b033-6d72925c7e9d req-b8345f47-e071-4498-b248-be33097ffc29 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.0834234
Jun 01 10:12:09.328199 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ca48e31a-3b9e-4435-b033-6d72925c7e9d req-61d52644-e31d-478c-b141-55db329e1f8f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1113193
Jun 01 10:12:09.944800 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e7449144-a246-4fc5-b10a-aad61cf1e466 req-fe239b4d-490a-4454-9a66-1cb085a0cc4b tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=1e2c4c59-e3af-4b2d-9a43-4620bfe3f8aa HTTP/1.1" status: 200  len: 210 time: 0.0429268
Jun 01 10:12:10.462532 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7c207b97-e388-42fa-8087-157704bb5419 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:10.527695 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5328df2-0847-4ee5-8774-502513cb6c3d req-ef90c4b6-5fa2-45e7-a1a0-d7ec68d8de59 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:10.529129 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a5328df2-0847-4ee5-8774-502513cb6c3d req-ef90c4b6-5fa2-45e7-a1a0-d7ec68d8de59 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.0824556
Jun 01 10:12:10.572444 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a5328df2-0847-4ee5-8774-502513cb6c3d req-110e9859-955b-401e-a5c1-be5e29688938 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0376928
Jun 01 10:12:10.727737 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device c6da8fab-3cf3-43a2-aff8-b6f43e149b0a no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:12:10.764671 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: c6da8fab-3cf3-43a2-aff8-b6f43e149b0a {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:12:10.765025 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device c6da8fab-3cf3-43a2-aff8-b6f43e149b0a not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:12:11.659065 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0b0e6eb-c6e6-4987-a60c-469b24818087 req-ecc723c6-3363-4358-9e4a-ec20403c955a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:11.661412 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f0b0e6eb-c6e6-4987-a60c-469b24818087 req-ecc723c6-3363-4358-9e4a-ec20403c955a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 946 time: 0.0810256
Jun 01 10:12:11.751608 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f0b0e6eb-c6e6-4987-a60c-469b24818087 req-3949c384-4597-4379-9377-cc079f5cca91 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0843854
Jun 01 10:12:11.797216 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7cb8ecd-01f6-45dd-895b-3924a8274afb req-e44e9f05-36b9-454c-9aa3-d54a31283a9b tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:11.798734 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f7cb8ecd-01f6-45dd-895b-3924a8274afb req-e44e9f05-36b9-454c-9aa3-d54a31283a9b tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.1034250
Jun 01 10:12:11.849348 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f7cb8ecd-01f6-45dd-895b-3924a8274afb req-32dbbedf-ce5f-4f3e-b981-3f8a76a9fc23 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0445123
Jun 01 10:12:12.942287 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-d4dd3b61-92f8-4872-9a6e-314905d689e8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:12.957456 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b76e1ff2-0206-42d5-914c-f71bd6d47e96 req-473972f2-d2bb-4139-ab24-2be60d03977f tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:12.959163 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b76e1ff2-0206-42d5-914c-f71bd6d47e96 req-473972f2-d2bb-4139-ab24-2be60d03977f tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 946 time: 0.0847828
Jun 01 10:12:13.056021 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b76e1ff2-0206-42d5-914c-f71bd6d47e96 req-67d87479-7cd3-4bc3-90fe-4729cc92f1ff tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0912104
Jun 01 10:12:13.090399 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72b290f6-3b75-4fbc-a77a-0d28e240bc03 req-7b8a91b9-2a85-484c-b777-0361a89674e0 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:13.091405 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-72b290f6-3b75-4fbc-a77a-0d28e240bc03 req-7b8a91b9-2a85-484c-b777-0361a89674e0 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.1105592
Jun 01 10:12:13.104333 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0a76fa6-f2b6-4144-8167-828bb27c552c req-12ea21ff-f11d-4200-a467-a90bd500d3f0 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:13.105057 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-f0a76fa6-f2b6-4144-8167-828bb27c552c req-12ea21ff-f11d-4200-a467-a90bd500d3f0 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Synchronizing usage tracker for tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe on resource:port {{(pid=92565) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:12:13.137676 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-72b290f6-3b75-4fbc-a77a-0d28e240bc03 req-8a737b7b-b5a5-4135-a918-c247b4249b8d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397365
Jun 01 10:12:13.210506 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-f0a76fa6-f2b6-4144-8167-828bb27c552c req-12ea21ff-f11d-4200-a467-a90bd500d3f0 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Unset dirty status for tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe on resource:port {{(pid=92565) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:12:13.211704 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-f0a76fa6-f2b6-4144-8167-828bb27c552c req-12ea21ff-f11d-4200-a467-a90bd500d3f0 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.30 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 946 time: 0.1910937
Jun 01 10:12:13.268743 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:13.362937 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [req-f0a76fa6-f2b6-4144-8167-828bb27c552c req-a61b46a1-944c-45e1-ab43-f48050b93c9a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Deleting port 41cda8ce-e474-41cf-9b05-6c4a119eed48 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:12:13.363279 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-f0a76fa6-f2b6-4144-8167-828bb27c552c req-a61b46a1-944c-45e1-ab43-f48050b93c9a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:13.583060 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-f0a76fa6-f2b6-4144-8167-828bb27c552c req-a61b46a1-944c-45e1-ab43-f48050b93c9a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] For port 41cda8ce-e474-41cf-9b05-6c4a119eed48, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=41cda8ce-e474-41cf-9b05-6c4a119eed48,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:12:13.583332 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-f0a76fa6-f2b6-4144-8167-828bb27c552c req-a61b46a1-944c-45e1-ab43-f48050b93c9a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:13.709146 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [req-f0a76fa6-f2b6-4144-8167-828bb27c552c req-a61b46a1-944c-45e1-ab43-f48050b93c9a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Calling delete_port for 41cda8ce-e474-41cf-9b05-6c4a119eed48 owned by compute:nova {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:12:13.862681 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-f0a76fa6-f2b6-4144-8167-828bb27c552c req-a61b46a1-944c-45e1-ab43-f48050b93c9a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:13.868678 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-0987daef-6448-4906-a938-fdf176468d34 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:13.875179 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['6010d8c0-403f-4393-8c5c-fd9cc14aeecb', '41cda8ce-e474-41cf-9b05-6c4a119eed48'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:12:13.919148 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a61b46a1-944c-45e1-ab43-f48050b93c9a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Pushing event deleted for resources: {'Port': ['ID=41cda8ce-e474-41cf-9b05-6c4a119eed48,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:13.950232 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a61b46a1-944c-45e1-ab43-f48050b93c9a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:13.993070 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [req-f0a76fa6-f2b6-4144-8167-828bb27c552c req-a61b46a1-944c-45e1-ab43-f48050b93c9a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] No DVR routers for this DVR port 41cda8ce-e474-41cf-9b05-6c4a119eed48 on host hv-cinder-78726 {{(pid=92565) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:12:13.995557 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-f0a76fa6-f2b6-4144-8167-828bb27c552c req-a61b46a1-944c-45e1-ab43-f48050b93c9a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:13.999372 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fa7939f0-81fb-44e7-a0fd-492428e5028b', 'name': 'network-vif-deleted', 'tag': '41cda8ce-e474-41cf-9b05-6c4a119eed48'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:12:14.001595 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-16645adf-79c0-409a-9ce1-e8562ab82225" -d '{"events": [{"server_uuid": "fa7939f0-81fb-44e7-a0fd-492428e5028b", "name": "network-vif-deleted", "tag": "41cda8ce-e474-41cf-9b05-6c4a119eed48"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:12:14.045362 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:12:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ab4c2a33-8dc1-4cd8-9be6-9f96aff52879 x-openstack-request-id: req-ab4c2a33-8dc1-4cd8-9be6-9f96aff52879 {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:12:14.045688 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fa7939f0-81fb-44e7-a0fd-492428e5028b", "name": "network-vif-deleted", "tag": "41cda8ce-e474-41cf-9b05-6c4a119eed48", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:12:14.045974 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-ab4c2a33-8dc1-4cd8-9be6-9f96aff52879 {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:12:14.046393 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fa7939f0-81fb-44e7-a0fd-492428e5028b', 'name': 'network-vif-deleted', 'tag': '41cda8ce-e474-41cf-9b05-6c4a119eed48', 'status': 'completed', 'code': 200}
Jun 01 10:12:14.071917 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:14.096405 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-f0a76fa6-f2b6-4144-8167-828bb27c552c req-a61b46a1-944c-45e1-ab43-f48050b93c9a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.30 "DELETE /v2.0/ports/41cda8ce-e474-41cf-9b05-6c4a119eed48 HTTP/1.1" status: 204  len: 173 time: 0.8783953
Jun 01 10:12:14.212843 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3a128a48-ccb1-4032-ba9b-a3f3714ca308 req-1dd9096c-2399-4fba-b970-c0246236c3c5 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=fa7939f0-81fb-44e7-a0fd-492428e5028b HTTP/1.1" status: 200  len: 210 time: 0.0452576
Jun 01 10:12:14.345601 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88fff31e-1dfc-43a0-affe-26601faf437b req-bbac65f9-0b1d-4c2e-ba52-f6d58f43f3ef tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:14.345601 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-88fff31e-1dfc-43a0-affe-26601faf437b req-bbac65f9-0b1d-4c2e-ba52-f6d58f43f3ef tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.0830157
Jun 01 10:12:14.389382 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-88fff31e-1dfc-43a0-affe-26601faf437b req-f45287e1-55f1-4aef-8dce-1b962c8a8b56 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0392342
Jun 01 10:12:15.246293 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 36272) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:15.306416 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_v2 [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Deleting subnet f256fe0c-ca2a-4bcd-87a4-40fba935858b {{(pid=92565) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 10:12:15.309626 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:15.358995 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2998467'] for subnet, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:15.419483 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7791835'] for subnet, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:15.596850 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e1872c-9bff-4e49-824b-f496df49845f req-67ca9025-fe7d-4b47-b1c6-5f89970f12d2 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:15.598860 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-62e1872c-9bff-4e49-824b-f496df49845f req-67ca9025-fe7d-4b47-b1c6-5f89970f12d2 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.0964065
Jun 01 10:12:15.649371 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-62e1872c-9bff-4e49-824b-f496df49845f req-e6549871-0592-45f5-98ef-c3c762896fb7 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0447257
Jun 01 10:12:15.765597 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7793006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2233195', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3139387'] for subnet, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:15.774887 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-ad93adc3-23b5-4e5a-88ad-d4a435020eca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:15.793708 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:15.810136 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f256fe0c-ca2a-4bcd-87a4-40fba935858b,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:15.812824 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:15.821920 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:15.822292 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:15.822665 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:15.823042 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:15.823396 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:15.823749 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:15.824096 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:15.824446 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:15.824793 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:15.825137 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:15.825479 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:15.825818 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:15.829399 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] 10.222.0.68 "DELETE /v2.0/subnets/f256fe0c-ca2a-4bcd-87a4-40fba935858b HTTP/1.1" status: 204  len: 168 time: 0.5820794
Jun 01 10:12:15.830350 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:15.832506 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 36284) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:15.940014 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-880be6c9-a772-429c-8ef6-f3d6c9e4a469 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7813807'] for network, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:16.064484 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-880be6c9-a772-429c-8ef6-f3d6c9e4a469 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7795028', 'neutron.services.segments.db._delete_segments_for_network-8726958294492'] for network, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:16.077040 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-880be6c9-a772-429c-8ef6-f3d6c9e4a469 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7efe72220190>,) {'filters': {'network_id': ['3a2e5ab1-9bd9-4597-be91-953ea2afbf4b']}} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:16.089610 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-880be6c9-a772-429c-8ef6-f3d6c9e4a469 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7efe72220190>, 'f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793') {'for_net_delete': True} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:16.089857 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-880be6c9-a772-429c-8ef6-f3d6c9e4a469 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7efe72220190>, 'f1cd5dcb-c7fb-4cfc-952d-e07f4afbc793') {} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:16.102380 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-880be6c9-a772-429c-8ef6-f3d6c9e4a469 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726958303133', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2998472'] for segment, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:16.118528 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-880be6c9-a772-429c-8ef6-f3d6c9e4a469 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:16.124434 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-880be6c9-a772-429c-8ef6-f3d6c9e4a469 admin admin] Releasing vlan 898 on physical network physnet1 to pool {{(pid=92565) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 10:12:16.126684 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-880be6c9-a772-429c-8ef6-f3d6c9e4a469 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2295757'] for segment, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]: Traceback (most recent call last):
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:     timer()
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:     cb(*args, **kw)
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:     return func(*args, **kwargs)
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:     self._notify()
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:     self.callback(batched_events)
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:     event.method(event)
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:     return f(self, *a, **k)
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._get(url).json()
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self.request(url, 'GET', **kwargs)
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 10:12:16.137745 dv-cinder-787262-4-iscsi neutron-server[92565]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 10:12:16.278059 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-880be6c9-a772-429c-8ef6-f3d6c9e4a469 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7795037', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-403638'] for network, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:16.281692 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:16.294729 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-880be6c9-a772-429c-8ef6-f3d6c9e4a469 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:16.303850 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-880be6c9-a772-429c-8ef6-f3d6c9e4a469 admin admin] Pushing event deleted for resources: {'Network': ['ID=3a2e5ab1-9bd9-4597-be91-953ea2afbf4b,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:16.306438 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-880be6c9-a772-429c-8ef6-f3d6c9e4a469 admin admin] 10.222.0.68 "DELETE /v2.0/networks/3a2e5ab1-9bd9-4597-be91-953ea2afbf4b HTTP/1.1" status: 204  len: 168 time: 0.4730065
Jun 01 10:12:16.307323 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-880be6c9-a772-429c-8ef6-f3d6c9e4a469 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:16.712807 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 36298) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:16.767984 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-e4815152-a7aa-4e36-ae41-df0392f671f1 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=80c0fea786fd4fb9afd054ddb2559c2a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0539582
Jun 01 10:12:16.770512 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 36302) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:16.777310 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 41cda8ce-e474-41cf-9b05-6c4a119eed48 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:12:16.821224 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: 41cda8ce-e474-41cf-9b05-6c4a119eed48 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:12:16.822419 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 41cda8ce-e474-41cf-9b05-6c4a119eed48 not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:12:16.833945 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-73966ac0-fda8-43b3-86c4-457e1e592d01 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:16.856528 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8022439-0d7b-4a08-86e1-e1cb71ca7380 req-24c99322-a3a7-4dc7-bc46-c1c6d18c951a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:16.858041 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d8022439-0d7b-4a08-86e1-e1cb71ca7380 req-24c99322-a3a7-4dc7-bc46-c1c6d18c951a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.0915189
Jun 01 10:12:16.859755 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-73966ac0-fda8-43b3-86c4-457e1e592d01 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:16.904206 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d8022439-0d7b-4a08-86e1-e1cb71ca7380 req-b9de678a-24bf-4eb3-a328-35125a07f476 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394022
Jun 01 10:12:17.016382 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-73966ac0-fda8-43b3-86c4-457e1e592d01 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:17.020173 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c0de67df-3fc9-4611-9670-6730141d258c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:17.032722 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73966ac0-fda8-43b3-86c4-457e1e592d01 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7940912d-cf3a-47b8-92ad-b536ac1d0a04,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:17.042389 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-73966ac0-fda8-43b3-86c4-457e1e592d01 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:17.043503 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-73966ac0-fda8-43b3-86c4-457e1e592d01 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:17.047008 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-73966ac0-fda8-43b3-86c4-457e1e592d01 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/7940912d-cf3a-47b8-92ad-b536ac1d0a04 HTTP/1.1" status: 204  len: 168 time: 0.2730989
Jun 01 10:12:17.265263 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0676d595-875c-4b89-84f8-25f84ec1ddb4 req-b0fcdcca-5500-47e1-bdf9-2279c4920b9e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:17.266776 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0676d595-875c-4b89-84f8-25f84ec1ddb4 req-b0fcdcca-5500-47e1-bdf9-2279c4920b9e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 945 time: 0.0863984
Jun 01 10:12:17.313176 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0676d595-875c-4b89-84f8-25f84ec1ddb4 req-2a9fd0a0-2398-4bc6-b9e1-cb8b02b61d0b tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407081
Jun 01 10:12:18.093457 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1ae2fe9-4e16-4e2c-94bf-a84716a08b4a req-06ba1771-e40f-4fd3-92d4-10a126707b37 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:18.094948 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e1ae2fe9-4e16-4e2c-94bf-a84716a08b4a req-06ba1771-e40f-4fd3-92d4-10a126707b37 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.0821764
Jun 01 10:12:18.139963 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e1ae2fe9-4e16-4e2c-94bf-a84716a08b4a req-314c5dff-18a0-4752-a426-e0f756ff96a7 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391583
Jun 01 10:12:18.145805 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 36332) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:18.248943 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1893805309-network', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:12:18.253501 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:12:18.258120 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Usage tracker for resource:network and tenant:42ccd1aa89a94252b32a254cead654ef is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:12:18.261027 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:12:18.266665 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:12:18.348045 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Made reservation on behalf of 42ccd1aa89a94252b32a254cead654ef for: {'network': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:12:18.350383 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:18.363937 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:18.378239 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:12:18.382892 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Usage tracker for resource:security_group_rule and tenant:42ccd1aa89a94252b32a254cead654ef is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:12:18.385723 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:12:18.391443 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:12:18.474266 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:18.505126 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e83c375b-30d9-46ef-a255-3c08460a42e3 req-cb7e923f-97d8-48a0-8686-5088026edb02 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:18.506622 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e83c375b-30d9-46ef-a255-3c08460a42e3 req-cb7e923f-97d8-48a0-8686-5088026edb02 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 945 time: 0.0843556
Jun 01 10:12:18.550401 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e83c375b-30d9-46ef-a255-3c08460a42e3 req-bb2d60ba-4e19-4b19-bcb2-1196316d8822 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/security-groups?id=bfdc1692-8d5a-493a-a2d7-b6e2daa11404&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0381496
Jun 01 10:12:18.560204 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:18.564435 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-73966ac0-fda8-43b3-86c4-457e1e592d01 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:18.590970 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 868}  {{(pid=92565) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:12:18.600090 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4c6403a1-41d1-46bb-a1d5-56a5a21fff27,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:18.605586 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:18.606502 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:18.606846 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.segments_db [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Added segment 4888209f-5226-40f1-b206-246370701bbd of type vlan for network d11181a0-389a-4fe3-b44f-805e01bb81e5
Jun 01 10:12:18.634054 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:18.707985 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:18.709437 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:18.710083 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:18.713726 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:18.961228 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Pushing event updated for resources: {'Network': ['ID=d11181a0-389a-4fe3-b44f-805e01bb81e5,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:18.965307 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.251s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:18.971972 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network d11181a0-389a-4fe3-b44f-805e01bb81e5 details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:12:19.002326 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48eec04-c8fe-4328-846e-4722efeb667b req-d5860224-ba6f-4172-bb1a-b4305f86593e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:19.003086 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-c48eec04-c8fe-4328-846e-4722efeb667b req-d5860224-ba6f-4172-bb1a-b4305f86593e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Synchronizing usage tracker for tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe on resource:port {{(pid=92565) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:12:19.008626 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 0.8617084
Jun 01 10:12:19.011547 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 36342) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:19.017506 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Request body: {'subnet': {'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1893805309-subnet', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'ip_version': 4}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:12:19.023587 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:12:19.027762 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Usage tracker for resource:subnet and tenant:42ccd1aa89a94252b32a254cead654ef is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:12:19.030795 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:12:19.037724 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:12:19.090713 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-c48eec04-c8fe-4328-846e-4722efeb667b req-d5860224-ba6f-4172-bb1a-b4305f86593e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Unset dirty status for tenant:4f2a9e1dcd084ba7aeb9c96724aea0fe on resource:port {{(pid=92565) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:12:19.091972 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-c48eec04-c8fe-4328-846e-4722efeb667b req-d5860224-ba6f-4172-bb1a-b4305f86593e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.30 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 945 time: 0.2138336
Jun 01 10:12:19.119178 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Made reservation on behalf of 42ccd1aa89a94252b32a254cead654ef for: {'subnet': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:12:19.121589 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2837918'] for subnet, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:19.239657 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [req-c48eec04-c8fe-4328-846e-4722efeb667b req-77674b7d-0ecc-422d-abdf-39b75e22c10e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Deleting port 6010d8c0-403f-4393-8c5c-fd9cc14aeecb {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:12:19.240258 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-c48eec04-c8fe-4328-846e-4722efeb667b req-77674b7d-0ecc-422d-abdf-39b75e22c10e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:19.386602 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-c48eec04-c8fe-4328-846e-4722efeb667b req-77674b7d-0ecc-422d-abdf-39b75e22c10e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] For port 6010d8c0-403f-4393-8c5c-fd9cc14aeecb, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=6010d8c0-403f-4393-8c5c-fd9cc14aeecb,segment=NetworkSegment(f512f187-5724-4ff7-afd5-c422b0bd8ba7),segment_id=f512f187-5724-4ff7-afd5-c422b0bd8ba7)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:12:19.387000 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-c48eec04-c8fe-4328-846e-4722efeb667b req-77674b7d-0ecc-422d-abdf-39b75e22c10e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:19.400461 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20e50a30-2c6d-4f64-9e72-9d8bfd21f663 req-63d9333f-fe58-42e4-95d7-816ea9b6fd56 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:19.401968 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-20e50a30-2c6d-4f64-9e72-9d8bfd21f663 req-63d9333f-fe58-42e4-95d7-816ea9b6fd56 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.1336010
Jun 01 10:12:19.449870 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-20e50a30-2c6d-4f64-9e72-9d8bfd21f663 req-0c23db99-b470-4913-9071-74e0629088a6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0418696
Jun 01 10:12:19.514301 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [req-c48eec04-c8fe-4328-846e-4722efeb667b req-77674b7d-0ecc-422d-abdf-39b75e22c10e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Calling delete_port for 6010d8c0-403f-4393-8c5c-fd9cc14aeecb owned by compute:nova {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:12:19.641086 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2818108', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2837896'] for subnet, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:19.644931 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:19.696709 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-c48eec04-c8fe-4328-846e-4722efeb667b req-77674b7d-0ecc-422d-abdf-39b75e22c10e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:19.703384 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-bfd4227b-fcff-4516-8cab-02c8edae6f48 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:19.709113 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['6010d8c0-403f-4393-8c5c-fd9cc14aeecb'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:12:19.819610 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3a79bcb1-c700-4624-ba44-cbca9baa342c req-99231ea3-9b90-40c3-93a3-a7ee5ab3e7b6 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.68 "GET /v2.0/ports?device_id=f243463c-ee21-4821-9149-223fc68552e4 HTTP/1.1" status: 200  len: 210 time: 0.0595946
Jun 01 10:12:19.825143 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77674b7d-0ecc-422d-abdf-39b75e22c10e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Pushing event deleted for resources: {'Port': ['ID=6010d8c0-403f-4393-8c5c-fd9cc14aeecb,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:19.834694 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-77674b7d-0ecc-422d-abdf-39b75e22c10e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:19.835580 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [req-c48eec04-c8fe-4328-846e-4722efeb667b req-77674b7d-0ecc-422d-abdf-39b75e22c10e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] No DVR routers for this DVR port 6010d8c0-403f-4393-8c5c-fd9cc14aeecb on host hv-cinder-78726 {{(pid=92565) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:12:19.837864 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-c48eec04-c8fe-4328-846e-4722efeb667b req-77674b7d-0ecc-422d-abdf-39b75e22c10e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:19.843850 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f243463c-ee21-4821-9149-223fc68552e4', 'name': 'network-vif-deleted', 'tag': '6010d8c0-403f-4393-8c5c-fd9cc14aeecb'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:12:19.846113 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c78f36d5-00c1-47ed-991c-d741e54f9efc" -d '{"events": [{"server_uuid": "f243463c-ee21-4821-9149-223fc68552e4", "name": "network-vif-deleted", "tag": "6010d8c0-403f-4393-8c5c-fd9cc14aeecb"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:12:19.854526 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Pushing event updated for resources: {'Subnet': ['ID=dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:19.864489 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Checking segment: {'id': '4888209f-5226-40f1-b206-246370701bbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:12:19.864847 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Network hostable DHCP agents. Network: d11181a0-389a-4fe3-b44f-805e01bb81e5, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92566) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:12:19.868308 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:19.874071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:19.874071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:19.874071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:19.874071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:19.874071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:19.874071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:19.874071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:19.874071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:19.874071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:19.874071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:19.874071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:19.879693 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.234s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:19.895816 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:12:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e7c8a4f9-9633-44e4-91bc-05dd129b4537 x-openstack-request-id: req-e7c8a4f9-9633-44e4-91bc-05dd129b4537 {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:12:19.896146 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f243463c-ee21-4821-9149-223fc68552e4", "name": "network-vif-deleted", "tag": "6010d8c0-403f-4393-8c5c-fd9cc14aeecb", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:12:19.896433 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-e7c8a4f9-9633-44e4-91bc-05dd129b4537 {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:12:19.896882 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f243463c-ee21-4821-9149-223fc68552e4', 'name': 'network-vif-deleted', 'tag': '6010d8c0-403f-4393-8c5c-fd9cc14aeecb', 'status': 'completed', 'code': 200}
Jun 01 10:12:19.919891 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-c48eec04-c8fe-4328-846e-4722efeb667b req-77674b7d-0ecc-422d-abdf-39b75e22c10e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] 10.222.0.30 "DELETE /v2.0/ports/6010d8c0-403f-4393-8c5c-fd9cc14aeecb HTTP/1.1" status: 204  len: 173 time: 0.8215790
Jun 01 10:12:19.936102 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Network d11181a0-389a-4fe3-b44f-805e01bb81e5 is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92566) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:12:19.991912 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, d11181a0-389a-4fe3-b44f-805e01bb81e5) {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:12:20.000806 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b462417d-dabe-44f3-88c4-82bd22dcfe65 None None] Network d11181a0-389a-4fe3-b44f-805e01bb81e5 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:12:20.006217 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:20.006217 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:20.073421 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 1.0605245
Jun 01 10:12:20.075952 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 36354) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:20.080927 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1893805309-router', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:12:20.085969 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:12:20.090371 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Usage tracker for resource:router and tenant:42ccd1aa89a94252b32a254cead654ef is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:12:20.093245 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:12:20.099643 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:12:20.192627 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-405701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15802'] for router, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:20.193852 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-407493', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-403482', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-465655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-15793'] for router, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:20.209680 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:20.242458 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ec86312-457d-532c-ad41-c4edfccc592e-d11181a0-389a-4fe3-b44f-805e01bb81e5', 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'fixed_ips': [{'subnet_id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9'}]}} from dv-cinder-787262-4-iscsi. {{(pid=92567) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 10:12:20.243333 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:20.405228 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.db_base_plugin_common [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Allocated IP 172.20.0.2 (d11181a0-389a-4fe3-b44f-805e01bb81e5/dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9/444a91a3-4487-42b5-8531-f7f926f82764) {{(pid=92567) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:12:20.614025 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-403519', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-405751', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-15815'] for router, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:20.634622 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Notify callbacks [] for port, precommit_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:20.646732 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Transition to ACTIVE for port object 444a91a3-4487-42b5-8531-f7f926f82764 will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:12:20.661535 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-026baa4f-a9e3-4da0-9c07-d2cb605e9973 req-e0005450-3ca5-4e5f-a4aa-d3141a098fbc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:20.661535 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-026baa4f-a9e3-4da0-9c07-d2cb605e9973 req-e0005450-3ca5-4e5f-a4aa-d3141a098fbc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.0903485
Jun 01 10:12:20.666096 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Transition to ACTIVE for port object 444a91a3-4487-42b5-8531-f7f926f82764 will not be triggered until provisioned by entity DHCP. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:12:20.723351 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-026baa4f-a9e3-4da0-9c07-d2cb605e9973 req-eff27c37-8cc5-40aa-9691-c257336361d7 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0584259
Jun 01 10:12:20.742861 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:20.751092 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:20.820424 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Network d11181a0-389a-4fe3-b44f-805e01bb81e5 is already hosted by enough agents. {{(pid=92567) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:12:20.823925 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.base_scheduler [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Resources bound (agent type, host, resource id):  {{(pid=92567) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:12:20.825838 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Pushing event updated for resources: {'Port': ['ID=444a91a3-4487-42b5-8531-f7f926f82764,revision_number=1']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:20.828101 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Received port after_create {{(pid=92567) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:12:20.838131 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:20.838493 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:20.838816 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:20.839172 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:20.839501 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:20.839829 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:20.840155 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:20.840479 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:20.840802 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:20.841123 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:20.841442 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:20.843143 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:20.868818 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:20.918182 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 36362) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:20.936622 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Attempting to bind port 444a91a3-4487-42b5-8531-f7f926f82764 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:12:20.937031 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Attempting to bind port 444a91a3-4487-42b5-8531-f7f926f82764 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '4888209f-5226-40f1-b206-246370701bbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:12:20.937399 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Attempting to bind port 444a91a3-4487-42b5-8531-f7f926f82764 on network d11181a0-389a-4fe3-b44f-805e01bb81e5 {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:12:20.944222 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 12, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:12:20.944604 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Checking segment: {'id': '4888209f-5226-40f1-b206-246370701bbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:12:20.945013 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:20.945410 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Bound using segment: {'id': '4888209f-5226-40f1-b206-246370701bbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:12:20.946036 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Bound port: 444a91a3-4487-42b5-8531-f7f926f82764, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4888209f-5226-40f1-b206-246370701bbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:12:20.946566 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:20.983601 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_v2 [None req-cdac678f-152e-4c40-a767-c7d05c25baeb admin admin] Deleting subnet abf69321-90c0-4336-ac76-6ef3766e6a67 {{(pid=92565) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 10:12:20.988746 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cdac678f-152e-4c40-a767-c7d05c25baeb admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:21.034382 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:21.039581 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-17933900-878c-41a0-95f6-2b51b579631e None None] For port 444a91a3-4487-42b5-8531-f7f926f82764, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:12:21.042843 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-17933900-878c-41a0-95f6-2b51b579631e None None] For port 444a91a3-4487-42b5-8531-f7f926f82764, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=444a91a3-4487-42b5-8531-f7f926f82764,segment=NetworkSegment(4888209f-5226-40f1-b206-246370701bbd),segment_id=4888209f-5226-40f1-b206-246370701bbd)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:12:21.044018 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cdac678f-152e-4c40-a767-c7d05c25baeb admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2998467'] for subnet, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:21.073622 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:21.103960 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cdac678f-152e-4c40-a767-c7d05c25baeb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7791835'] for subnet, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:21.125543 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:21.133576 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:21.212267 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Pushing event updated for resources: {'Port': ['ID=444a91a3-4487-42b5-8531-f7f926f82764,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:21.217343 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Allocated IP 172.27.2.221 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/20ab6db7-2733-4461-a34b-d10f79cc0d29) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:12:21.228461 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:21.376892 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:21.445717 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cdac678f-152e-4c40-a767-c7d05c25baeb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7793006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2233195', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3139387'] for subnet, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:21.454625 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-3169d60d-a706-434c-b411-e460f5112265 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:21.478244 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:21.484092 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:21.490022 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdac678f-152e-4c40-a767-c7d05c25baeb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=abf69321-90c0-4336-ac76-6ef3766e6a67,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:21.493030 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-cdac678f-152e-4c40-a767-c7d05c25baeb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:21.493989 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cdac678f-152e-4c40-a767-c7d05c25baeb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:21.502591 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-cdac678f-152e-4c40-a767-c7d05c25baeb admin admin] 10.222.0.68 "DELETE /v2.0/subnets/abf69321-90c0-4336-ac76-6ef3766e6a67 HTTP/1.1" status: 204  len: 168 time: 0.5805485
Jun 01 10:12:21.503013 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 36368) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:21.544983 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:12:21.547999 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:12:21.551801 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:12:21.603970 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Pushing event updated for resources: {'Port': ['ID=20ab6db7-2733-4461-a34b-d10f79cc0d29,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:21.607920 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:21.618512 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-939a3f3d-55c6-423a-aca0-c21cbb60616a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7813807'] for network, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:21.649532 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 444a91a3-4487-42b5-8531-f7f926f82764 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:12:21.788235 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 444a91a3-4487-42b5-8531-f7f926f82764 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:12:21.854174 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-939a3f3d-55c6-423a-aca0-c21cbb60616a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7795028', 'neutron.services.segments.db._delete_segments_for_network-8726958294492'] for network, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:21.868078 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-939a3f3d-55c6-423a-aca0-c21cbb60616a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7efe72674280>,) {'filters': {'network_id': ['95462097-1cc6-4207-9add-1b65afcf40ca']}} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:21.880733 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-939a3f3d-55c6-423a-aca0-c21cbb60616a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7efe72674280>, 'f512f187-5724-4ff7-afd5-c422b0bd8ba7') {'for_net_delete': True} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:21.881282 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-939a3f3d-55c6-423a-aca0-c21cbb60616a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7efe72674280>, 'f512f187-5724-4ff7-afd5-c422b0bd8ba7') {} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:21.893691 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-939a3f3d-55c6-423a-aca0-c21cbb60616a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726958303133', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2998472'] for segment, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:21.912384 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-939a3f3d-55c6-423a-aca0-c21cbb60616a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:21.918973 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-939a3f3d-55c6-423a-aca0-c21cbb60616a admin admin] Releasing vlan 897 on physical network physnet1 to pool {{(pid=92565) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 10:12:21.919638 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-939a3f3d-55c6-423a-aca0-c21cbb60616a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2295757'] for segment, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]: Traceback (most recent call last):
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:     timer()
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:     cb(*args, **kw)
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:     return func(*args, **kwargs)
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:     self._notify()
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:     self.callback(batched_events)
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:     event.method(event)
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:     return f(self, *a, **k)
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._get(url).json()
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self.request(url, 'GET', **kwargs)
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 10:12:21.932625 dv-cinder-787262-4-iscsi neutron-server[92565]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 10:12:22.001053 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e15f49d-f972-4830-b0da-1316bd2df6c6 req-f7241e92-98ca-4dff-b5e2-751b95e928b9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:22.002767 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6e15f49d-f972-4830-b0da-1316bd2df6c6 req-f7241e92-98ca-4dff-b5e2-751b95e928b9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.1516249
Jun 01 10:12:22.074194 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-939a3f3d-55c6-423a-aca0-c21cbb60616a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7795037', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-403638'] for network, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:22.078284 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-be2839f2-674b-4811-80c0-3ca51d6e7d31 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:22.092206 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-939a3f3d-55c6-423a-aca0-c21cbb60616a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:22.104997 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-939a3f3d-55c6-423a-aca0-c21cbb60616a admin admin] Pushing event deleted for resources: {'Network': ['ID=95462097-1cc6-4207-9add-1b65afcf40ca,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:22.112833 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-939a3f3d-55c6-423a-aca0-c21cbb60616a admin admin] 10.222.0.68 "DELETE /v2.0/networks/95462097-1cc6-4207-9add-1b65afcf40ca HTTP/1.1" status: 204  len: 168 time: 0.6077735
Jun 01 10:12:22.112833 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-939a3f3d-55c6-423a-aca0-c21cbb60616a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:22.133292 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6e15f49d-f972-4830-b0da-1316bd2df6c6 req-4f551986-4aed-483a-a305-5168b78c3664 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1201437
Jun 01 10:12:22.188823 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce723f49-1801-4a7e-830c-f53213d59e8e None None] Network d11181a0-389a-4fe3-b44f-805e01bb81e5 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:12:22.271148 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:22.412542 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7beff344-1bfb-4569-84cf-099411530e0e None None] Provisioning for port 444a91a3-4487-42b5-8531-f7f926f82764 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:12:22.425329 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7beff344-1bfb-4569-84cf-099411530e0e None None] Provisioning complete for port 444a91a3-4487-42b5-8531-f7f926f82764 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:22.425633 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7beff344-1bfb-4569-84cf-099411530e0e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:22.546245 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 36378) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:22.561574 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7beff344-1bfb-4569-84cf-099411530e0e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:22.602936 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7beff344-1bfb-4569-84cf-099411530e0e None None] For port 444a91a3-4487-42b5-8531-f7f926f82764, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=444a91a3-4487-42b5-8531-f7f926f82764,segment=NetworkSegment(4888209f-5226-40f1-b206-246370701bbd),segment_id=4888209f-5226-40f1-b206-246370701bbd)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:12:22.616030 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-a522038f-7edc-45a7-b2f9-a60fd20bb492 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=4f2a9e1dcd084ba7aeb9c96724aea0fe&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0682318
Jun 01 10:12:22.616810 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 36382) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:22.654404 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-405708', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-403580'] for router, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:22.666817 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7beff344-1bfb-4569-84cf-099411530e0e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:22.668650 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-b149b621-1507-4344-8ea8-b2288ecfd170 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:22.734700 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7beff344-1bfb-4569-84cf-099411530e0e None None] Pushing event updated for resources: {'Port': ['ID=444a91a3-4487-42b5-8531-f7f926f82764,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:22.737794 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7beff344-1bfb-4569-84cf-099411530e0e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:22.774289 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2d8a00f4-6630-48b4-bf27-b8cdad5baf46 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:22.787619 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-6d1f6f13-4b43-4383-a842-d0b3cab625d3 None None] Provisioning complete for port 444a91a3-4487-42b5-8531-f7f926f82764 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:22.788126 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-6d1f6f13-4b43-4383-a842-d0b3cab625d3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:22.819688 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 15ce50f0-fa11-464b-a55e-f6f214c49154 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:12:22.821713 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 6010d8c0-403f-4393-8c5c-fd9cc14aeecb no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:12:22.865912 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: 6010d8c0-403f-4393-8c5c-fd9cc14aeecb {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:12:22.866254 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 6010d8c0-403f-4393-8c5c-fd9cc14aeecb not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:12:22.876103 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2d8a00f4-6630-48b4-bf27-b8cdad5baf46 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:23.016320 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Router d44c71f4-9c5a-4af0-9ac9-0a309921c707 is scheduled to L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c with binding_index 1 {{(pid=92566) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 10:12:23.082786 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2d8a00f4-6630-48b4-bf27-b8cdad5baf46 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:23.094042 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:23.094946 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 15ce50f0-fa11-464b-a55e-f6f214c49154, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=15ce50f0-fa11-464b-a55e-f6f214c49154,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:12:23.108751 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': '15ce50f0-fa11-464b-a55e-f6f214c49154', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'port_id': '15ce50f0-fa11-464b-a55e-f6f214c49154', 'mac_address': 'fa:16:3e:9f:c6:d9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 861, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:12:23.124038 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d8a00f4-6630-48b4-bf27-b8cdad5baf46 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bfdc1692-8d5a-493a-a2d7-b6e2daa11404,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:23.126437 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-2d8a00f4-6630-48b4-bf27-b8cdad5baf46 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:23.172947 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:23.191026 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 15ce50f0-fa11-464b-a55e-f6f214c49154 {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:12:23.208394 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 15ce50f0-fa11-464b-a55e-f6f214c49154, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=15ce50f0-fa11-464b-a55e-f6f214c49154,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:12:23.217266 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2d8a00f4-6630-48b4-bf27-b8cdad5baf46 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:23.220862 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-2d8a00f4-6630-48b4-bf27-b8cdad5baf46 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/bfdc1692-8d5a-493a-a2d7-b6e2daa11404 HTTP/1.1" status: 204  len: 168 time: 0.6006489
Jun 01 10:12:23.244531 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:12:23.256231 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Sync routers for ids ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:12:23.269460 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Routers {'d44c71f4-9c5a-4af0-9ac9-0a309921c707'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:12:23.270100 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe725b1bb0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:12:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:23.349020 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:23.358694 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:23.406933 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Notify callbacks [] for router, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:23.408988 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] 10.222.0.68 "POST /v2.0/routers HTTP/1.1" status: 201  len: 927 time: 3.3313675
Jun 01 10:12:23.413861 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 36392) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:23.417791 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee1ad27b-9175-4267-9e54-337abc8915dd req-c0240797-57d5-43a2-a6f4-90241eea5334 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:23.419432 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ee1ad27b-9175-4267-9e54-337abc8915dd req-c0240797-57d5-43a2-a6f4-90241eea5334 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 944 time: 0.1365569
Jun 01 10:12:23.468443 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ee1ad27b-9175-4267-9e54-337abc8915dd req-297c14fb-b87b-4616-99f0-36782a5fe919 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397425
Jun 01 10:12:23.491708 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['15ce50f0-fa11-464b-a55e-f6f214c49154'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:12:23.571599 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=15ce50f0-fa11-464b-a55e-f6f214c49154,revision_number=6']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:23.577807 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.219s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:23.606587 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Set router d44c71f4-9c5a-4af0-9ac9-0a309921c707 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:12:23.657602 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 444a91a3-4487-42b5-8531-f7f926f82764 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:12:23.752993 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6252141-1e80-450b-9244-d845903d3620 req-11809334-9e3d-4c34-ad8a-15e9dd2a2c4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:23.754552 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b6252141-1e80-450b-9244-d845903d3620 req-11809334-9e3d-4c34-ad8a-15e9dd2a2c4d service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=f4f6f875519045a39c1fdbadd53ce517&device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 1097 time: 0.2489514
Jun 01 10:12:23.962554 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 444a91a3-4487-42b5-8531-f7f926f82764 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:23.962995 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:24.118889 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6252141-1e80-450b-9244-d845903d3620 req-99efa6ff-fbde-4c60-9ac7-656a8707bd9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:24.120251 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b6252141-1e80-450b-9244-d845903d3620 req-99efa6ff-fbde-4c60-9ac7-656a8707bd9e service neutron] 10.222.0.30 "GET /v2.0/networks?id=be546533-cf92-483d-9e38-7d14ca9c4902 HTTP/1.1" status: 200  len: 917 time: 0.2892535
Jun 01 10:12:24.165256 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe725b1bb0>, [{'id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'name': 'tempest-TestMinimumBasicScenario-1893805309-router', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221'}], 'enable_snat': True}, 'gw_port_id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:20Z', 'updated_at': '2021-06-01T10:12:21Z', 'revision_number': 3, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'gw_port': {'id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:01:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:21Z', 'updated_at': '2021-06-01T10:12:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:24.171150 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Checking router: d44c71f4-9c5a-4af0-9ac9-0a309921c707 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:12:24.171504 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Updating router d44c71f4-9c5a-4af0-9ac9-0a309921c707 port 20ab6db7-2733-4461-a34b-d10f79cc0d29 binding host dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:12:24.231212 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:24.278840 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b6252141-1e80-450b-9244-d845903d3620 req-645c527a-3c51-4a15-ad9f-21ccb1c5ca74 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=15ce50f0-fa11-464b-a55e-f6f214c49154 HTTP/1.1" status: 200  len: 1000 time: 0.1490979
Jun 01 10:12:24.399053 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6252141-1e80-450b-9244-d845903d3620 req-2db5a459-1d8d-4f01-a8c7-c30483422066 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:24.400433 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b6252141-1e80-450b-9244-d845903d3620 req-2db5a459-1d8d-4f01-a8c7-c30483422066 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=f2fdda64-a03c-41d7-8178-daca0363bd6e HTTP/1.1" status: 200  len: 855 time: 0.1079123
Jun 01 10:12:24.650353 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:24.700371 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Notify callbacks [] for port, precommit_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:24.713796 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Transition to ACTIVE for port object 20ab6db7-2733-4461-a34b-d10f79cc0d29 will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:12:24.726327 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6252141-1e80-450b-9244-d845903d3620 req-c0ba238b-91a2-4beb-bb48-29b6ba3b687a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:24.727830 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b6252141-1e80-450b-9244-d845903d3620 req-c0ba238b-91a2-4beb-bb48-29b6ba3b687a service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=be546533-cf92-483d-9e38-7d14ca9c4902&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3016281
Jun 01 10:12:24.787748 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:24.789943 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f57fea03-2d8f-4ee6-a437-690ce3e0a5f2 req-9139ba20-7d49-4fac-be3c-40b605ce2258 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:24.792188 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:24.798105 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f57fea03-2d8f-4ee6-a437-690ce3e0a5f2 req-9139ba20-7d49-4fac-be3c-40b605ce2258 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 944 time: 0.1132760
Jun 01 10:12:24.856463 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 15ce50f0-fa11-464b-a55e-f6f214c49154 up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:12:24.864252 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f57fea03-2d8f-4ee6-a437-690ce3e0a5f2 req-0ca5de13-d5e9-450f-b6b2-2384b7b4529c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0650029
Jun 01 10:12:24.954515 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75d1443d-095c-4fc2-9900-951b4b0462a5 None None] Pushing event updated for resources: {'Port': ['ID=20ab6db7-2733-4461-a34b-d10f79cc0d29,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:24.968340 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-75d1443d-095c-4fc2-9900-951b4b0462a5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:24.982152 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b6252141-1e80-450b-9244-d845903d3620 req-318e6133-f863-4baa-b7b9-5efb346270b6 service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2435241
Jun 01 10:12:24.995693 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Attempting to bind port 20ab6db7-2733-4461-a34b-d10f79cc0d29 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:12:24.996069 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Attempting to bind port 20ab6db7-2733-4461-a34b-d10f79cc0d29 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:12:24.996437 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Attempting to bind port 20ab6db7-2733-4461-a34b-d10f79cc0d29 on network a961b732-0873-4e86-af5a-7e84ae1a2549 {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:12:25.010841 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 12, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:12:25.022356 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Checking segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:12:25.022356 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:25.022356 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Bound using segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:12:25.022356 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Bound port: 20ab6db7-2733-4461-a34b-d10f79cc0d29, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:12:25.022356 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:25.023025 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Allocated IP 172.20.0.1 (d11181a0-389a-4fe3-b44f-805e01bb81e5/dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9/0c15f869-9e44-4931-a089-e90025a105a3) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:12:25.067834 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port 15ce50f0-fa11-464b-a55e-f6f214c49154 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:25.068210 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:25.158245 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] For port 20ab6db7-2733-4461-a34b-d10f79cc0d29, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:12:25.218777 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] For port 20ab6db7-2733-4461-a34b-d10f79cc0d29, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=20ab6db7-2733-4461-a34b-d10f79cc0d29,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:12:25.236087 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b6252141-1e80-450b-9244-d845903d3620 req-ff125110-dc45-48d7-b3aa-a0ea68b89e0c service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2343740
Jun 01 10:12:25.236219 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:25.264777 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0043671-b417-407f-944f-21d4e3af4137', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '15ce50f0-fa11-464b-a55e-f6f214c49154'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:12:25.271763 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ef139cc6-e8d5-4c63-8dde-989c6e65e60a" -d '{"events": [{"server_uuid": "e0043671-b417-407f-944f-21d4e3af4137", "name": "network-vif-plugged", "status": "completed", "tag": "15ce50f0-fa11-464b-a55e-f6f214c49154"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:12:25.278543 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 15ce50f0-fa11-464b-a55e-f6f214c49154, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=15ce50f0-fa11-464b-a55e-f6f214c49154,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:12:25.298137 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:25.302423 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:25.305274 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:25.334632 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.provisioning_blocks [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Transition to ACTIVE for port object 0c15f869-9e44-4931-a089-e90025a105a3 will not be triggered until provisioned by entity DHCP. {{(pid=92565) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:12:25.362979 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:12:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ea18b2b8-964d-408e-95d2-0ec6dbbc013b x-openstack-request-id: req-ea18b2b8-964d-408e-95d2-0ec6dbbc013b {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:12:25.363239 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e0043671-b417-407f-944f-21d4e3af4137", "name": "network-vif-plugged", "status": "completed", "tag": "15ce50f0-fa11-464b-a55e-f6f214c49154", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:12:25.363677 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-ea18b2b8-964d-408e-95d2-0ec6dbbc013b {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:12:25.364266 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e0043671-b417-407f-944f-21d4e3af4137', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '15ce50f0-fa11-464b-a55e-f6f214c49154', 'code': 200}
Jun 01 10:12:25.395554 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:25.411956 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Routers {'d44c71f4-9c5a-4af0-9ac9-0a309921c707'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:12:25.412626 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe725b1bb0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:12:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:25.445723 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:25.451012 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:25.486560 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75d1443d-095c-4fc2-9900-951b4b0462a5 None None] Pushing event updated for resources: {'Port': ['ID=20ab6db7-2733-4461-a34b-d10f79cc0d29,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:25.499423 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-75d1443d-095c-4fc2-9900-951b4b0462a5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.195s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:25.500028 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-1a666e11-ead8-4d6a-aa8a-98b778c07451 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.099s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:25.524406 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Pushing event updated for resources: {'Port': ['ID=0c15f869-9e44-4931-a089-e90025a105a3,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:25.527733 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:25.544639 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Network d11181a0-389a-4fe3-b44f-805e01bb81e5 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:12:25.546983 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:12:25.552497 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:12:25.638240 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-401677'] for router_interface, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:25.657352 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=15ce50f0-fa11-464b-a55e-f6f214c49154,revision_number=7']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:25.661904 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:25.692764 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] Set router d44c71f4-9c5a-4af0-9ac9-0a309921c707 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:12:25.993118 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 36480) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:26.002076 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:26.110333 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-b32ca29c-5409-49b0-9595-2c983b6a2b69 None None] Provisioning for port 0c15f869-9e44-4931-a089-e90025a105a3 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:12:26.122141 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-b32ca29c-5409-49b0-9595-2c983b6a2b69 None None] Provisioning complete for port 0c15f869-9e44-4931-a089-e90025a105a3 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:26.122668 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b32ca29c-5409-49b0-9595-2c983b6a2b69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:26.211541 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-b32ca29c-5409-49b0-9595-2c983b6a2b69 None None] Port 0c15f869-9e44-4931-a089-e90025a105a3 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:12:26.228731 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe725b1bb0>, [{'id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'name': 'tempest-TestMinimumBasicScenario-1893805309-router', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221'}], 'enable_snat': True}, 'gw_port_id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:20Z', 'updated_at': '2021-06-01T10:12:21Z', 'revision_number': 3, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'gw_port': {'id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:01:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:21Z', 'updated_at': '2021-06-01T10:12:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:26.240675 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-deedae44-f27f-4ce0-9118-3765d27cffe0 None None] The sync data for ids ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'] in dv-cinder-787262-4-iscsi is: [{'id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'name': 'tempest-TestMinimumBasicScenario-1893805309-router', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221'}], 'enable_snat': True}, 'gw_port_id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:20Z', 'updated_at': '2021-06-01T10:12:21Z', 'revision_number': 3, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'gw_port': {'id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:01:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:21Z', 'updated_at': '2021-06-01T10:12:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:12:26.314600 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:26.414499 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2295697'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:26.465172 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b155e7c0-a7af-4fc6-9ccd-65094c260f4d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:26.469759 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c33dc524-d5e7-425d-aeda-62895eca8e39 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:26.472992 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:12:26.486435 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-b155e7c0-a7af-4fc6-9ccd-65094c260f4d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:12:26.503122 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-b155e7c0-a7af-4fc6-9ccd-65094c260f4d admin admin] Usage tracker for resource:security_group_rule and tenant:2d781c0110f74ecaba333713ef0b8c0c is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:12:26.506992 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-b155e7c0-a7af-4fc6-9ccd-65094c260f4d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:12:26.514381 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-b155e7c0-a7af-4fc6-9ccd-65094c260f4d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:12:26.531070 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b1a094-0233-45d6-9d0e-e35223db9ea7 req-5b183943-8d00-4e25-80f3-5a83e87023a7 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:26.543612 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e1b1a094-0233-45d6-9d0e-e35223db9ea7 req-5b183943-8d00-4e25-80f3-5a83e87023a7 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.3153894
Jun 01 10:12:26.559459 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:26.562280 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7873030', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-401824'] for router_interface, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:26.625001 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Pushing event updated for resources: {'Port': ['ID=0c15f869-9e44-4931-a089-e90025a105a3,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:26.629276 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e1b1a094-0233-45d6-9d0e-e35223db9ea7 req-b4541421-0f6e-4008-8ff0-a87f5ce25637 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0839229
Jun 01 10:12:26.630633 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:26.772362 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b155e7c0-a7af-4fc6-9ccd-65094c260f4d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:26.812319 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Network d11181a0-389a-4fe3-b44f-805e01bb81e5 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:12:26.813804 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:12:26.851994 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b155e7c0-a7af-4fc6-9ccd-65094c260f4d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:26.865972 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1e386557-86be-4f49-892c-bc93ea57eebb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.002s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:27.009549 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-b155e7c0-a7af-4fc6-9ccd-65094c260f4d admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=2d781c0110f74ecaba333713ef0b8c0c&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0151951
Jun 01 10:12:27.014590 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 36488) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:27.038205 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b155e7c0-a7af-4fc6-9ccd-65094c260f4d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cdc273d1-68d9-43de-a75b-c346169f633a,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:27.044982 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b155e7c0-a7af-4fc6-9ccd-65094c260f4d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:27.124690 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Router d44c71f4-9c5a-4af0-9ac9-0a309921c707 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:12:27.128201 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-76bf3392-1a06-4c8a-809d-0ead6896647a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:27.168895 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-76bf3392-1a06-4c8a-809d-0ead6896647a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:27.255510 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-f8c9220c-649c-461f-bf88-97b14e23a838 None None] Provisioning complete for port 0c15f869-9e44-4931-a089-e90025a105a3 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:27.256074 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-f8c9220c-649c-461f-bf88-97b14e23a838 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:27.323699 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-76bf3392-1a06-4c8a-809d-0ead6896647a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:27.328937 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7ab04cf3-d4c5-4e33-bacc-b1c7d0aab6a3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:27.346185 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-f8c9220c-649c-461f-bf88-97b14e23a838 None None] Port 0c15f869-9e44-4931-a089-e90025a105a3 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:12:27.360133 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76bf3392-1a06-4c8a-809d-0ead6896647a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cdc273d1-68d9-43de-a75b-c346169f633a,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:27.368526 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-76bf3392-1a06-4c8a-809d-0ead6896647a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:27.379531 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-76bf3392-1a06-4c8a-809d-0ead6896647a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:27.385990 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-76bf3392-1a06-4c8a-809d-0ead6896647a admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/cdc273d1-68d9-43de-a75b-c346169f633a HTTP/1.1" status: 204  len: 168 time: 0.3654196
Jun 01 10:12:27.581542 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:12:27.600717 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] 10.222.0.68 "PUT /v2.0/routers/d44c71f4-9c5a-4af0-9ac9-0a309921c707/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.1849747
Jun 01 10:12:27.682295 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 20ab6db7-2733-4461-a34b-d10f79cc0d29 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:12:27.855310 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 20ab6db7-2733-4461-a34b-d10f79cc0d29 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:12:27.860823 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 20ab6db7-2733-4461-a34b-d10f79cc0d29 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:27.861408 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:27.915856 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75337ed6-d7b2-461a-b736-a05d64eaf0cd req-9cb91bc4-c620-4588-9f0c-e9fb972424dc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:27.923906 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-75337ed6-d7b2-461a-b736-a05d64eaf0cd req-9cb91bc4-c620-4588-9f0c-e9fb972424dc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.1301248
Jun 01 10:12:28.003349 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-75337ed6-d7b2-461a-b736-a05d64eaf0cd req-a6746108-0eac-4f67-abb1-4f42d4afee0a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0749729
Jun 01 10:12:28.043325 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:28.077561 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 20ab6db7-2733-4461-a34b-d10f79cc0d29, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=20ab6db7-2733-4461-a34b-d10f79cc0d29,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:12:28.146585 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:28.151074 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:28.277217 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=20ab6db7-2733-4461-a34b-d10f79cc0d29,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:28.280792 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:28.513187 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Sync routers for ids ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:12:28.529155 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Routers {'d44c71f4-9c5a-4af0-9ac9-0a309921c707'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:12:28.531641 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe728d86a0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:12:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:28.760390 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 36528) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:28.766031 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Set router d44c71f4-9c5a-4af0-9ac9-0a309921c707 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:12:28.771806 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1300067728-network', 'tenant_id': '9721bcf37577404fb3a206dac7fa327f'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:12:28.782622 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:12:28.788548 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Usage tracker for resource:network and tenant:9721bcf37577404fb3a206dac7fa327f is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:12:28.793925 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:12:28.805092 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:12:28.902276 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Made reservation on behalf of 9721bcf37577404fb3a206dac7fa327f for: {'network': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:12:28.905498 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:28.929332 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:28.955824 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:12:28.961146 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Usage tracker for resource:security_group_rule and tenant:9721bcf37577404fb3a206dac7fa327f is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:12:28.965139 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:12:28.972906 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:12:29.135323 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:29.145379 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe728d86a0>, [{'id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'name': 'tempest-TestMinimumBasicScenario-1893805309-router', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221'}], 'enable_snat': True}, 'gw_port_id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:20Z', 'updated_at': '2021-06-01T10:12:25Z', 'revision_number': 4, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'gw_port': {'id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:01:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:21Z', 'updated_at': '2021-06-01T10:12:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '0c15f869-9e44-4931-a089-e90025a105a3', 'name': '', 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'mac_address': 'fa:16:3e:7a:de:be', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_interface', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:24Z', 'updated_at': '2021-06-01T10:12:26Z', 'revision_number': 2, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'subnets': [{'id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:29.159146 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Checking router: d44c71f4-9c5a-4af0-9ac9-0a309921c707 for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:12:29.160328 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Updating router d44c71f4-9c5a-4af0-9ac9-0a309921c707 port 0c15f869-9e44-4931-a089-e90025a105a3 binding host dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:12:29.198164 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:29.201297 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-75a652f9-3652-4972-b729-4e01d20b11f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:29.224692 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:29.235751 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b54ccf3-fb8c-476b-bb77-9d433b41b18c req-8d5560f7-a697-4bf8-9c49-b7de63af9d9a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:29.244104 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9b54ccf3-fb8c-476b-bb77-9d433b41b18c req-8d5560f7-a697-4bf8-9c49-b7de63af9d9a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.1063771
Jun 01 10:12:29.246626 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 871}  {{(pid=92565) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:12:29.284808 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eb53d77a-bcfc-4b51-aafa-1de3751c229e,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:29.305712 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:29.306948 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:29.312526 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9b54ccf3-fb8c-476b-bb77-9d433b41b18c req-9b029138-04a3-4502-ba00-dfe6c9126c29 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0673697
Jun 01 10:12:29.314469 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.segments_db [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Added segment 803e39bb-16e7-471c-9371-b6d1deca6924 of type vlan for network 981d1c8a-385a-4744-9bf1-eed77f908044
Jun 01 10:12:29.372506 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:29.468094 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:29.469442 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:29.470054 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:29.493175 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:29.574100 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 0.8116817
Jun 01 10:12:29.576869 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 36544) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:29.584439 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] Request body: {'subnet': {'network_id': '981d1c8a-385a-4744-9bf1-eed77f908044', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1300067728-subnet', 'tenant_id': '9721bcf37577404fb3a206dac7fa327f', 'ip_version': 4}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:12:29.594413 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:12:29.603030 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Pushing event updated for resources: {'Network': ['ID=981d1c8a-385a-4744-9bf1-eed77f908044,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:29.607359 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:29.608139 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] Usage tracker for resource:subnet and tenant:9721bcf37577404fb3a206dac7fa327f is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:12:29.615859 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network 981d1c8a-385a-4744-9bf1-eed77f908044 details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:12:29.616370 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:12:29.623741 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:12:29.685256 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] Made reservation on behalf of 9721bcf37577404fb3a206dac7fa327f for: {'subnet': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:12:29.688191 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2837918'] for subnet, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:29.774620 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Notify callbacks [] for port, precommit_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:29.788982 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.provisioning_blocks [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Transition to ACTIVE for port object 0c15f869-9e44-4931-a089-e90025a105a3 will not be triggered until provisioned by entity L2. {{(pid=92568) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:12:29.826155 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 20ab6db7-2733-4461-a34b-d10f79cc0d29 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:12:29.866759 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:29.872575 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-68c1fac1-3db5-4562-bdd9-96a0277000f1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:29.927767 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 20ab6db7-2733-4461-a34b-d10f79cc0d29 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:29.927767 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:30.017340 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b202a9f-552c-4d83-98e1-8bcb063f3e9e None None] Pushing event updated for resources: {'Port': ['ID=0c15f869-9e44-4931-a089-e90025a105a3,revision_number=3']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:30.035994 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b202a9f-552c-4d83-98e1-8bcb063f3e9e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:30.036464 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b202a9f-552c-4d83-98e1-8bcb063f3e9e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:30.039664 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b202a9f-552c-4d83-98e1-8bcb063f3e9e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:30.040150 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b202a9f-552c-4d83-98e1-8bcb063f3e9e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:30.040481 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b202a9f-552c-4d83-98e1-8bcb063f3e9e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:30.041077 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b202a9f-552c-4d83-98e1-8bcb063f3e9e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:30.041399 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b202a9f-552c-4d83-98e1-8bcb063f3e9e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:30.041711 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b202a9f-552c-4d83-98e1-8bcb063f3e9e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:30.042039 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b202a9f-552c-4d83-98e1-8bcb063f3e9e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:30.044943 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b202a9f-552c-4d83-98e1-8bcb063f3e9e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:30.045291 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b202a9f-552c-4d83-98e1-8bcb063f3e9e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:30.045605 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b202a9f-552c-4d83-98e1-8bcb063f3e9e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:12:30.072538 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-3b202a9f-552c-4d83-98e1-8bcb063f3e9e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:30.280630 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Attempting to bind port 0c15f869-9e44-4931-a089-e90025a105a3 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:12:30.281067 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Attempting to bind port 0c15f869-9e44-4931-a089-e90025a105a3 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '4888209f-5226-40f1-b206-246370701bbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5'}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:12:30.281491 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Attempting to bind port 0c15f869-9e44-4931-a089-e90025a105a3 on network d11181a0-389a-4fe3-b44f-805e01bb81e5 {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:12:30.305001 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 12, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:12:30.306031 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Checking segment: {'id': '4888209f-5226-40f1-b206-246370701bbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92568) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:12:30.306031 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:30.306365 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Bound using segment: {'id': '4888209f-5226-40f1-b206-246370701bbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5'} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:12:30.309486 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Bound port: 0c15f869-9e44-4931-a089-e90025a105a3, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4888209f-5226-40f1-b206-246370701bbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5'}}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:12:30.310321 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:30.444444 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] For port 0c15f869-9e44-4931-a089-e90025a105a3, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92568) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:12:30.449563 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] For port 0c15f869-9e44-4931-a089-e90025a105a3, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=0c15f869-9e44-4931-a089-e90025a105a3,segment=NetworkSegment(4888209f-5226-40f1-b206-246370701bbd),segment_id=4888209f-5226-40f1-b206-246370701bbd)] {{(pid=92568) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:12:30.516943 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2818108', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2837896'] for subnet, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:30.526229 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:30.619826 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] Pushing event updated for resources: {'Subnet': ['ID=1e6ba067-5116-43a9-829c-16e65dbec6a4,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:30.623725 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:30.630001 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] Checking segment: {'id': '803e39bb-16e7-471c-9371-b6d1deca6924', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '981d1c8a-385a-4744-9bf1-eed77f908044'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:12:30.630359 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] Network hostable DHCP agents. Network: 981d1c8a-385a-4744-9bf1-eed77f908044, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92566) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:12:30.642739 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958de256-8194-4880-8f6f-460e586f9cbd req-13fdf9bf-6ad6-4db7-b3ef-26b0ca17c7a6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:30.644241 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-958de256-8194-4880-8f6f-460e586f9cbd req-13fdf9bf-6ad6-4db7-b3ef-26b0ca17c7a6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.2068284
Jun 01 10:12:30.700282 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-958de256-8194-4880-8f6f-460e586f9cbd req-7733dd74-eac6-4788-b5c5-84cf95d56b9b tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0472021
Jun 01 10:12:30.872363 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:30.876451 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-3b202a9f-552c-4d83-98e1-8bcb063f3e9e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:30.912157 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] Network 981d1c8a-385a-4744-9bf1-eed77f908044 is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92566) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:12:30.949852 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Routers {'d44c71f4-9c5a-4af0-9ac9-0a309921c707'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:12:30.950462 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe728d86a0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:12:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:31.007396 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b202a9f-552c-4d83-98e1-8bcb063f3e9e None None] Pushing event updated for resources: {'Port': ['ID=0c15f869-9e44-4931-a089-e90025a105a3,revision_number=4']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:31.017650 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-3b202a9f-552c-4d83-98e1-8bcb063f3e9e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:31.022406 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, 981d1c8a-385a-4744-9bf1-eed77f908044) {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:12:31.044893 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53e3e423-428a-4fc7-9176-6d44dea62163 None None] Network 981d1c8a-385a-4744-9bf1-eed77f908044 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:12:31.051384 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:31.052033 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:31.154721 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 1.5766730
Jun 01 10:12:31.157275 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 36572) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:31.163048 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1300067728-router', 'tenant_id': '9721bcf37577404fb3a206dac7fa327f', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:12:31.169037 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:12:31.181477 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Usage tracker for resource:router and tenant:9721bcf37577404fb3a206dac7fa327f is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:12:31.187285 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:12:31.211219 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:12:31.233368 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] Set router d44c71f4-9c5a-4af0-9ac9-0a309921c707 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:12:31.332653 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-405701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15802'] for router, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:31.333944 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-407493', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-403482', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-465655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-15793'] for router, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:31.358148 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:31.359938 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ec86312-457d-532c-ad41-c4edfccc592e-981d1c8a-385a-4744-9bf1-eed77f908044', 'network_id': '981d1c8a-385a-4744-9bf1-eed77f908044', 'tenant_id': '9721bcf37577404fb3a206dac7fa327f', 'fixed_ips': [{'subnet_id': '1e6ba067-5116-43a9-829c-16e65dbec6a4'}]}} from dv-cinder-787262-4-iscsi. {{(pid=92567) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 10:12:31.360861 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:31.371272 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 36578) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:31.612477 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2de62a68-cf63-4da1-a674-e12e6234a745 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:31.645641 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.db_base_plugin_common [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Allocated IP 172.20.0.2 (981d1c8a-385a-4744-9bf1-eed77f908044/1e6ba067-5116-43a9-829c-16e65dbec6a4/a5b75de4-5365-42f2-b609-e23b646786e5) {{(pid=92567) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:12:31.646666 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-2de62a68-cf63-4da1-a674-e12e6234a745 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:12:31.655389 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-2de62a68-cf63-4da1-a674-e12e6234a745 admin admin] Usage tracker for resource:security_group_rule and tenant:659ce798691c40b996cbc9dedfdf18df is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:12:31.666846 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-2de62a68-cf63-4da1-a674-e12e6234a745 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:12:31.679710 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-2de62a68-cf63-4da1-a674-e12e6234a745 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:12:31.697627 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe728d86a0>, [{'id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'name': 'tempest-TestMinimumBasicScenario-1893805309-router', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221'}], 'enable_snat': True}, 'gw_port_id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:20Z', 'updated_at': '2021-06-01T10:12:25Z', 'revision_number': 4, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'gw_port': {'id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:01:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:21Z', 'updated_at': '2021-06-01T10:12:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '0c15f869-9e44-4931-a089-e90025a105a3', 'name': '', 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'mac_address': 'fa:16:3e:7a:de:be', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_interface', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:24Z', 'updated_at': '2021-06-01T10:12:30Z', 'revision_number': 4, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'subnets': [{'id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:31.702513 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dffc2ff4-12e6-48af-9833-9b40bb392a37 None None] The sync data for ids ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'] in dv-cinder-787262-4-iscsi is: [{'id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'name': 'tempest-TestMinimumBasicScenario-1893805309-router', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221'}], 'enable_snat': True}, 'gw_port_id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:20Z', 'updated_at': '2021-06-01T10:12:25Z', 'revision_number': 4, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'gw_port': {'id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:01:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:21Z', 'updated_at': '2021-06-01T10:12:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '0c15f869-9e44-4931-a089-e90025a105a3', 'name': '', 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'mac_address': 'fa:16:3e:7a:de:be', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_interface', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:24Z', 'updated_at': '2021-06-01T10:12:30Z', 'revision_number': 4, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'subnets': [{'id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:12:31.875056 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2de62a68-cf63-4da1-a674-e12e6234a745 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:31.929294 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2de62a68-cf63-4da1-a674-e12e6234a745 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:31.931958 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-403519', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-405751', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-15815'] for router, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:31.952958 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f8bfc0e4-25d2-4b1e-b577-5fe3a2155523 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:32.007268 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-2de62a68-cf63-4da1-a674-e12e6234a745 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=659ce798691c40b996cbc9dedfdf18df&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6321230
Jun 01 10:12:32.008222 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 36588) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:32.027575 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2de62a68-cf63-4da1-a674-e12e6234a745 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd5e280f-c1b1-4ce3-ba77-04e4adedbb45,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:32.034539 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-2de62a68-cf63-4da1-a674-e12e6234a745 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:32.092349 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41c898bd-ace0-4c31-9256-49a3e87941c8 req-8a14788c-cfeb-4323-acde-4cdbd2fce001 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:32.101689 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-41c898bd-ace0-4c31-9256-49a3e87941c8 req-8a14788c-cfeb-4323-acde-4cdbd2fce001 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.1520634
Jun 01 10:12:32.119432 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-126332fa-8eba-4fb2-a6b0-36d2b3ae630f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:32.157673 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Notify callbacks [] for port, precommit_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:32.174843 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Transition to ACTIVE for port object a5b75de4-5365-42f2-b609-e23b646786e5 will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:12:32.177234 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-126332fa-8eba-4fb2-a6b0-36d2b3ae630f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:32.213710 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Transition to ACTIVE for port object a5b75de4-5365-42f2-b609-e23b646786e5 will not be triggered until provisioned by entity DHCP. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:12:32.360326 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:32.368976 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-41c898bd-ace0-4c31-9256-49a3e87941c8 req-e73aa310-57cb-420a-99a0-b72879b46f86 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2657578
Jun 01 10:12:32.375620 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:32.411549 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-126332fa-8eba-4fb2-a6b0-36d2b3ae630f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:32.417143 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-91796621-0211-4b79-a2b6-0609d0a4ade6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:32.449802 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-126332fa-8eba-4fb2-a6b0-36d2b3ae630f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd5e280f-c1b1-4ce3-ba77-04e4adedbb45,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:32.455284 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-126332fa-8eba-4fb2-a6b0-36d2b3ae630f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:32.460951 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-126332fa-8eba-4fb2-a6b0-36d2b3ae630f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:32.462118 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-126332fa-8eba-4fb2-a6b0-36d2b3ae630f admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/bd5e280f-c1b1-4ce3-ba77-04e4adedbb45 HTTP/1.1" status: 204  len: 168 time: 0.4529006
Jun 01 10:12:32.467648 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Network 981d1c8a-385a-4744-9bf1-eed77f908044 is already hosted by enough agents. {{(pid=92567) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:12:32.484346 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.base_scheduler [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Resources bound (agent type, host, resource id):  {{(pid=92567) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:12:32.499511 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Received port after_create {{(pid=92567) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:12:32.599428 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Pushing event updated for resources: {'Port': ['ID=a5b75de4-5365-42f2-b609-e23b646786e5,revision_number=1']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:32.610454 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:32.629973 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Attempting to bind port a5b75de4-5365-42f2-b609-e23b646786e5 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:12:32.631122 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Attempting to bind port a5b75de4-5365-42f2-b609-e23b646786e5 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '803e39bb-16e7-471c-9371-b6d1deca6924', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '981d1c8a-385a-4744-9bf1-eed77f908044'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:12:32.631865 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Attempting to bind port a5b75de4-5365-42f2-b609-e23b646786e5 on network 981d1c8a-385a-4744-9bf1-eed77f908044 {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:12:32.651110 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 12, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:12:32.651531 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Checking segment: {'id': '803e39bb-16e7-471c-9371-b6d1deca6924', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '981d1c8a-385a-4744-9bf1-eed77f908044'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:12:32.654612 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:32.655060 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Bound using segment: {'id': '803e39bb-16e7-471c-9371-b6d1deca6924', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '981d1c8a-385a-4744-9bf1-eed77f908044'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:12:32.655572 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Bound port: a5b75de4-5365-42f2-b609-e23b646786e5, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '803e39bb-16e7-471c-9371-b6d1deca6924', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '981d1c8a-385a-4744-9bf1-eed77f908044'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:12:32.655959 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:32.793756 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] For port a5b75de4-5365-42f2-b609-e23b646786e5, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:12:32.798839 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] For port a5b75de4-5365-42f2-b609-e23b646786e5, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=a5b75de4-5365-42f2-b609-e23b646786e5,segment=NetworkSegment(803e39bb-16e7-471c-9371-b6d1deca6924),segment_id=803e39bb-16e7-471c-9371-b6d1deca6924)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:12:32.826574 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:32.870792 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:32.880713 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:32.884907 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:33.052803 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Pushing event updated for resources: {'Port': ['ID=a5b75de4-5365-42f2-b609-e23b646786e5,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:33.058227 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:33.133746 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Allocated IP 172.27.2.228 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/3fd04673-71e3-44bb-96f0-c953a4732ecf) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:12:33.236442 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 36598) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:33.279806 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-e1eec368-d24c-43e5-a007-837c47a4ca10 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:33.317587 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-e1eec368-d24c-43e5-a007-837c47a4ca10 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:12:33.330504 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-e1eec368-d24c-43e5-a007-837c47a4ca10 admin admin] Usage tracker for resource:security_group_rule and tenant:3d9025697c384757becb82c06b9717d1 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:12:33.336530 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-e1eec368-d24c-43e5-a007-837c47a4ca10 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:12:33.369606 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-e1eec368-d24c-43e5-a007-837c47a4ca10 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:12:33.511108 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:33.521568 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-e1eec368-d24c-43e5-a007-837c47a4ca10 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:33.609069 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-e1eec368-d24c-43e5-a007-837c47a4ca10 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:33.619028 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b03be602-b662-4f3c-864f-7021354b8399 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:33.702950 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-e1eec368-d24c-43e5-a007-837c47a4ca10 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=3d9025697c384757becb82c06b9717d1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4606919
Jun 01 10:12:33.702950 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1eec368-d24c-43e5-a007-837c47a4ca10 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=144e4fda-c0be-4a9c-ab5b-a43172e7547a,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:33.704773 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 36604) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:33.712460 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:33.725141 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-2064d620-65c4-4c22-8fce-065830d74ae8 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:33.738036 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-e1eec368-d24c-43e5-a007-837c47a4ca10 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:33.804109 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device a5b75de4-5365-42f2-b609-e23b646786e5 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:12:33.821356 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c3a0879d-6f4f-4dd3-9ed8-7d5c1a9f2942 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:33.843027 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:12:33.852561 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:12:33.862596 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:12:33.870632 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c3a0879d-6f4f-4dd3-9ed8-7d5c1a9f2942 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:33.913977 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Pushing event updated for resources: {'Port': ['ID=3fd04673-71e3-44bb-96f0-c953a4732ecf,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:33.919241 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:33.945205 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47541273-5a39-436f-baf6-b6f6466ddc6b req-5fb29063-1cd5-45f2-9a2f-46c58e197de6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:33.946799 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47541273-5a39-436f-baf6-b6f6466ddc6b req-5fb29063-1cd5-45f2-9a2f-46c58e197de6 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.3242509
Jun 01 10:12:33.999972 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port a5b75de4-5365-42f2-b609-e23b646786e5 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:12:34.011355 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 0c15f869-9e44-4931-a089-e90025a105a3 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:12:34.073497 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c3a0879d-6f4f-4dd3-9ed8-7d5c1a9f2942 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:34.077613 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f9d9fe87-69d2-4771-ab3e-ce86fb7ff9f6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:34.096095 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3a0879d-6f4f-4dd3-9ed8-7d5c1a9f2942 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=144e4fda-c0be-4a9c-ab5b-a43172e7547a,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:34.113300 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c3a0879d-6f4f-4dd3-9ed8-7d5c1a9f2942 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:34.121086 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c3a0879d-6f4f-4dd3-9ed8-7d5c1a9f2942 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:34.133474 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-c3a0879d-6f4f-4dd3-9ed8-7d5c1a9f2942 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/144e4fda-c0be-4a9c-ab5b-a43172e7547a HTTP/1.1" status: 204  len: 168 time: 0.4214208
Jun 01 10:12:34.193423 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 0c15f869-9e44-4931-a089-e90025a105a3 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:12:34.201094 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 0c15f869-9e44-4931-a089-e90025a105a3 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:34.203401 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:34.364422 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-47541273-5a39-436f-baf6-b6f6466ddc6b req-4dc5bfd1-27c7-4a55-8ed5-32c3c97104d8 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.4026241
Jun 01 10:12:34.473318 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:34.578670 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 0c15f869-9e44-4931-a089-e90025a105a3, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=0c15f869-9e44-4931-a089-e90025a105a3,segment=NetworkSegment(4888209f-5226-40f1-b206-246370701bbd),segment_id=4888209f-5226-40f1-b206-246370701bbd)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:12:34.650933 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:34.659232 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:34.712537 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ecfd5ab9-ac51-4b12-896b-987f50b7ff73 None None] Network 981d1c8a-385a-4744-9bf1-eed77f908044 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:12:34.722943 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:34.916606 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=0c15f869-9e44-4931-a089-e90025a105a3,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:34.924851 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.262s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:35.092730 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-e749928b-302e-422f-8a6f-f4513c715aea None None] Provisioning for port a5b75de4-5365-42f2-b609-e23b646786e5 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:12:35.110364 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-e749928b-302e-422f-8a6f-f4513c715aea None None] Provisioning complete for port a5b75de4-5365-42f2-b609-e23b646786e5 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:35.110744 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-e749928b-302e-422f-8a6f-f4513c715aea None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:35.266424 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-e749928b-302e-422f-8a6f-f4513c715aea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:35.345419 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-e749928b-302e-422f-8a6f-f4513c715aea None None] For port a5b75de4-5365-42f2-b609-e23b646786e5, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=a5b75de4-5365-42f2-b609-e23b646786e5,segment=NetworkSegment(803e39bb-16e7-471c-9371-b6d1deca6924),segment_id=803e39bb-16e7-471c-9371-b6d1deca6924)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:12:35.362847 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-405708', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-403580'] for router, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:35.439316 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-e749928b-302e-422f-8a6f-f4513c715aea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:35.441134 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:35.648560 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-6d82fa16-c14e-49c0-8b0e-3b1d5666141b None None] Provisioning complete for port a5b75de4-5365-42f2-b609-e23b646786e5 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:35.649199 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-6d82fa16-c14e-49c0-8b0e-3b1d5666141b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:35.698507 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e749928b-302e-422f-8a6f-f4513c715aea None None] Pushing event updated for resources: {'Port': ['ID=a5b75de4-5365-42f2-b609-e23b646786e5,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:35.702366 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 0c15f869-9e44-4931-a089-e90025a105a3 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:12:35.739808 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-e749928b-302e-422f-8a6f-f4513c715aea None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.298s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:35.820393 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b6a06d4-9b82-4dc1-b016-56b5d837f313 req-a2859e91-ee0c-4490-b129-2b94f99d0a0d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:35.824790 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4b6a06d4-9b82-4dc1-b016-56b5d837f313 req-a2859e91-ee0c-4490-b129-2b94f99d0a0d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.1653025
Jun 01 10:12:35.856308 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 0c15f869-9e44-4931-a089-e90025a105a3 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:35.857652 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:35.879619 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Router 0e328557-86fb-4850-b12b-8b85478844e6 is scheduled to L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c with binding_index 1 {{(pid=92566) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 10:12:36.014529 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4b6a06d4-9b82-4dc1-b016-56b5d837f313 req-d1fea7e3-3533-46be-8e37-b623bd378cb4 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1755795
Jun 01 10:12:36.160433 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:12:36.169856 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Sync routers for ids ['0e328557-86fb-4850-b12b-8b85478844e6'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:12:36.185761 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Routers {'0e328557-86fb-4850-b12b-8b85478844e6'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:12:36.187834 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe728fdc10>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:12:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['0e328557-86fb-4850-b12b-8b85478844e6'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:36.280212 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Notify callbacks [] for router, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:36.284110 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] 10.222.0.68 "POST /v2.0/routers HTTP/1.1" status: 201  len: 927 time: 5.1232998
Jun 01 10:12:36.284404 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 36644) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:36.420819 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Set router 0e328557-86fb-4850-b12b-8b85478844e6 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:12:36.740461 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe728fdc10>, [{'id': '0e328557-86fb-4850-b12b-8b85478844e6', 'name': 'tempest-TestMinimumBasicScenario-1300067728-router', 'tenant_id': '9721bcf37577404fb3a206dac7fa327f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.228'}], 'enable_snat': True}, 'gw_port_id': '3fd04673-71e3-44bb-96f0-c953a4732ecf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:31Z', 'updated_at': '2021-06-01T10:12:34Z', 'revision_number': 3, 'project_id': '9721bcf37577404fb3a206dac7fa327f', 'gw_port': {'id': '3fd04673-71e3-44bb-96f0-c953a4732ecf', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:38:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0e328557-86fb-4850-b12b-8b85478844e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:32Z', 'updated_at': '2021-06-01T10:12:33Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:36.745776 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Checking router: 0e328557-86fb-4850-b12b-8b85478844e6 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:12:36.746467 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Updating router 0e328557-86fb-4850-b12b-8b85478844e6 port 3fd04673-71e3-44bb-96f0-c953a4732ecf binding host dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:12:36.809361 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:37.259999 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:37.328118 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Notify callbacks [] for port, precommit_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:37.346420 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Transition to ACTIVE for port object 3fd04673-71e3-44bb-96f0-c953a4732ecf will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:12:37.366995 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b0cf3bd-7c79-47f9-83b2-568a9df534d7 req-34f46788-e3a1-4d76-8aca-991324247215 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:37.368703 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9b0cf3bd-7c79-47f9-83b2-568a9df534d7 req-34f46788-e3a1-4d76-8aca-991324247215 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.1834979
Jun 01 10:12:37.494427 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9b0cf3bd-7c79-47f9-83b2-568a9df534d7 req-3ec20859-d779-4a12-88ab-6b57fabdae86 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1117787
Jun 01 10:12:37.526107 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:37.548467 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:37.656248 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Allocated IP 172.20.0.1 (981d1c8a-385a-4744-9bf1-eed77f908044/1e6ba067-5116-43a9-829c-16e65dbec6a4/d2139598-554e-4cfa-9b10-3f093985a6a5) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:12:37.685290 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Attempting to bind port 3fd04673-71e3-44bb-96f0-c953a4732ecf on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:12:37.686069 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Attempting to bind port 3fd04673-71e3-44bb-96f0-c953a4732ecf by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:12:37.686607 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Attempting to bind port 3fd04673-71e3-44bb-96f0-c953a4732ecf on network a961b732-0873-4e86-af5a-7e84ae1a2549 {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:12:37.689120 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device a5b75de4-5365-42f2-b609-e23b646786e5 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:12:37.742272 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b7ed480-9fa1-4ad3-bbc3-02d884d646ff None None] Pushing event updated for resources: {'Port': ['ID=3fd04673-71e3-44bb-96f0-c953a4732ecf,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:37.762813 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-4b7ed480-9fa1-4ad3-bbc3-02d884d646ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.211s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:37.771356 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 12, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:12:37.771768 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Checking segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:12:37.772152 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:37.772555 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Bound using segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:12:37.773192 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Bound port: 3fd04673-71e3-44bb-96f0-c953a4732ecf, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:12:37.773581 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:37.853924 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:37.863893 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] For port 3fd04673-71e3-44bb-96f0-c953a4732ecf, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:12:37.867227 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] For port 3fd04673-71e3-44bb-96f0-c953a4732ecf, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=3fd04673-71e3-44bb-96f0-c953a4732ecf,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:12:37.883090 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Transition to ACTIVE for port object d2139598-554e-4cfa-9b10-3f093985a6a5 will not be triggered until provisioned by entity DHCP. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:12:37.887295 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port a5b75de4-5365-42f2-b609-e23b646786e5 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:37.896029 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:37.958488 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:37.967623 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-cbcfdbcc-d3a2-428f-9c78-364da0b088a6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:37.994301 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:38.000232 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-339e9192-e00e-4306-88dc-297fe8b75992 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:38.129967 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Routers {'0e328557-86fb-4850-b12b-8b85478844e6'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:12:38.131112 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe728fdc10>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:12:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['0e328557-86fb-4850-b12b-8b85478844e6'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:38.133911 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Network 981d1c8a-385a-4744-9bf1-eed77f908044 is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:12:38.150246 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:12:38.153332 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:12:38.216518 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b7ed480-9fa1-4ad3-bbc3-02d884d646ff None None] Pushing event updated for resources: {'Port': ['ID=3fd04673-71e3-44bb-96f0-c953a4732ecf,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:38.251979 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-4b7ed480-9fa1-4ad3-bbc3-02d884d646ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.284s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:38.274586 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-401677'] for router_interface, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:38.306651 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Pushing event updated for resources: {'Port': ['ID=d2139598-554e-4cfa-9b10-3f093985a6a5,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:38.315821 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.316s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:38.502302 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] Set router 0e328557-86fb-4850-b12b-8b85478844e6 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:12:38.622796 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-2af1cc21-e790-45af-9088-f208dd05b774 None None] Provisioning for port d2139598-554e-4cfa-9b10-3f093985a6a5 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:12:38.632749 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:38.640535 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-2af1cc21-e790-45af-9088-f208dd05b774 None None] Provisioning complete for port d2139598-554e-4cfa-9b10-3f093985a6a5 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:38.640535 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-2af1cc21-e790-45af-9088-f208dd05b774 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:38.869870 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-2af1cc21-e790-45af-9088-f208dd05b774 None None] Port d2139598-554e-4cfa-9b10-3f093985a6a5 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:12:39.068292 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe728fdc10>, [{'id': '0e328557-86fb-4850-b12b-8b85478844e6', 'name': 'tempest-TestMinimumBasicScenario-1300067728-router', 'tenant_id': '9721bcf37577404fb3a206dac7fa327f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.228'}], 'enable_snat': True}, 'gw_port_id': '3fd04673-71e3-44bb-96f0-c953a4732ecf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:31Z', 'updated_at': '2021-06-01T10:12:34Z', 'revision_number': 3, 'project_id': '9721bcf37577404fb3a206dac7fa327f', 'gw_port': {'id': '3fd04673-71e3-44bb-96f0-c953a4732ecf', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:38:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0e328557-86fb-4850-b12b-8b85478844e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:32Z', 'updated_at': '2021-06-01T10:12:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:39.163553 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-300255ae-cb40-4e9c-8f37-725cd5f4745c None None] The sync data for ids ['0e328557-86fb-4850-b12b-8b85478844e6'] in dv-cinder-787262-4-iscsi is: [{'id': '0e328557-86fb-4850-b12b-8b85478844e6', 'name': 'tempest-TestMinimumBasicScenario-1300067728-router', 'tenant_id': '9721bcf37577404fb3a206dac7fa327f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.228'}], 'enable_snat': True}, 'gw_port_id': '3fd04673-71e3-44bb-96f0-c953a4732ecf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:31Z', 'updated_at': '2021-06-01T10:12:34Z', 'revision_number': 3, 'project_id': '9721bcf37577404fb3a206dac7fa327f', 'gw_port': {'id': '3fd04673-71e3-44bb-96f0-c953a4732ecf', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:38:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0e328557-86fb-4850-b12b-8b85478844e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:32Z', 'updated_at': '2021-06-01T10:12:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:12:39.163701 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3429fbc6-7e5a-482a-96d6-91cc6b813226 req-93de8dc6-eb29-4396-9a16-cf2944b2b78d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:39.163701 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3429fbc6-7e5a-482a-96d6-91cc6b813226 req-93de8dc6-eb29-4396-9a16-cf2944b2b78d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.1543224
Jun 01 10:12:39.163701 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:39.221183 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3429fbc6-7e5a-482a-96d6-91cc6b813226 req-4c1bf53b-7488-4f2c-8519-d6db4748a9c7 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0786839
Jun 01 10:12:39.265898 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:39.291918 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6b4ce60d-0cf9-4a2b-a37f-ef9fd718bc46 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:39.369374 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Pushing event updated for resources: {'Port': ['ID=d2139598-554e-4cfa-9b10-3f093985a6a5,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:39.377079 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:39.423824 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7873030', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-401824'] for router_interface, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:39.650829 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Network 981d1c8a-385a-4744-9bf1-eed77f908044 is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:12:39.652329 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:12:39.731821 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 3fd04673-71e3-44bb-96f0-c953a4732ecf up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:12:39.929902 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 3fd04673-71e3-44bb-96f0-c953a4732ecf completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:12:39.936421 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 3fd04673-71e3-44bb-96f0-c953a4732ecf triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:39.937157 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:40.115880 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Router 0e328557-86fb-4850-b12b-8b85478844e6 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92566) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:12:40.173599 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:40.213776 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 3fd04673-71e3-44bb-96f0-c953a4732ecf, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=3fd04673-71e3-44bb-96f0-c953a4732ecf,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:12:40.214946 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-99703ab3-5f46-41a6-9d9f-ee949b425642 None None] Provisioning complete for port d2139598-554e-4cfa-9b10-3f093985a6a5 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:40.217945 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-99703ab3-5f46-41a6-9d9f-ee949b425642 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:40.318419 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:40.329467 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:40.480929 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=3fd04673-71e3-44bb-96f0-c953a4732ecf,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:40.498343 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:40.512711 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-99703ab3-5f46-41a6-9d9f-ee949b425642 None None] Port d2139598-554e-4cfa-9b10-3f093985a6a5 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:12:40.589437 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:12:40.593819 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8a8b4f98-27f6-4df5-994e-0fe46969918a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:40.618993 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] 10.222.0.68 "PUT /v2.0/routers/0e328557-86fb-4850-b12b-8b85478844e6/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.3296099
Jun 01 10:12:40.659350 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69746d6a-ae7b-4da9-a9f3-56ad0524c860 req-5990a184-5a5b-4864-bb31-46ec11e30eec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:40.664725 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-69746d6a-ae7b-4da9-a9f3-56ad0524c860 req-5990a184-5a5b-4864-bb31-46ec11e30eec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.1467271
Jun 01 10:12:40.738728 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-69746d6a-ae7b-4da9-a9f3-56ad0524c860 req-d92dafa4-1590-4d71-ad00-10957eb5b1c0 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0691683
Jun 01 10:12:41.376829 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Sync routers for ids ['0e328557-86fb-4850-b12b-8b85478844e6'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:12:41.390408 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Routers {'0e328557-86fb-4850-b12b-8b85478844e6'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:12:41.394007 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe73485310>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:12:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['0e328557-86fb-4850-b12b-8b85478844e6'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:41.726430 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 3fd04673-71e3-44bb-96f0-c953a4732ecf up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:12:41.727074 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Set router 0e328557-86fb-4850-b12b-8b85478844e6 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:12:41.821883 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 3fd04673-71e3-44bb-96f0-c953a4732ecf triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:41.822485 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:42.248312 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef71867d-80a8-4a31-8ef8-c9c061c97f2d req-96c4e0db-022f-41c2-a2c4-48aa351de595 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:42.248312 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ef71867d-80a8-4a31-8ef8-c9c061c97f2d req-96c4e0db-022f-41c2-a2c4-48aa351de595 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.0966511
Jun 01 10:12:42.248312 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ef71867d-80a8-4a31-8ef8-c9c061c97f2d req-cf63a6a3-a053-467e-88df-56453e019eb5 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0403755
Jun 01 10:12:42.249641 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe73485310>, [{'id': '0e328557-86fb-4850-b12b-8b85478844e6', 'name': 'tempest-TestMinimumBasicScenario-1300067728-router', 'tenant_id': '9721bcf37577404fb3a206dac7fa327f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.228'}], 'enable_snat': True}, 'gw_port_id': '3fd04673-71e3-44bb-96f0-c953a4732ecf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:31Z', 'updated_at': '2021-06-01T10:12:38Z', 'revision_number': 4, 'project_id': '9721bcf37577404fb3a206dac7fa327f', 'gw_port': {'id': '3fd04673-71e3-44bb-96f0-c953a4732ecf', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:38:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e328557-86fb-4850-b12b-8b85478844e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:32Z', 'updated_at': '2021-06-01T10:12:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'd2139598-554e-4cfa-9b10-3f093985a6a5', 'name': '', 'network_id': '981d1c8a-385a-4744-9bf1-eed77f908044', 'tenant_id': '9721bcf37577404fb3a206dac7fa327f', 'mac_address': 'fa:16:3e:47:3d:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0e328557-86fb-4850-b12b-8b85478844e6', 'device_owner': 'network:router_interface', 'standard_attr_id': 481, 'fixed_ips': [{'subnet_id': '1e6ba067-5116-43a9-829c-16e65dbec6a4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:37Z', 'updated_at': '2021-06-01T10:12:38Z', 'revision_number': 2, 'project_id': '9721bcf37577404fb3a206dac7fa327f', 'subnets': [{'id': '1e6ba067-5116-43a9-829c-16e65dbec6a4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:42.249641 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Checking router: 0e328557-86fb-4850-b12b-8b85478844e6 for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:12:42.249641 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Updating router 0e328557-86fb-4850-b12b-8b85478844e6 port d2139598-554e-4cfa-9b10-3f093985a6a5 binding host dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:12:42.249641 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:42.518799 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Notify callbacks [] for port, precommit_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:42.530525 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.provisioning_blocks [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Transition to ACTIVE for port object d2139598-554e-4cfa-9b10-3f093985a6a5 will not be triggered until provisioned by entity L2. {{(pid=92568) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:12:42.635762 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:42.642992 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:42.952690 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-413e03cb-7754-47c3-88bc-b2b038742d6d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:43.011929 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20547a9b-5e3f-43b8-bb0d-ba0a451f8398 None None] Pushing event updated for resources: {'Port': ['ID=d2139598-554e-4cfa-9b10-3f093985a6a5,revision_number=3']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:43.024741 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-20547a9b-5e3f-43b8-bb0d-ba0a451f8398 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.378s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:43.054582 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Attempting to bind port d2139598-554e-4cfa-9b10-3f093985a6a5 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:12:43.055474 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Attempting to bind port d2139598-554e-4cfa-9b10-3f093985a6a5 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '803e39bb-16e7-471c-9371-b6d1deca6924', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '981d1c8a-385a-4744-9bf1-eed77f908044'}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:12:43.057605 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Attempting to bind port d2139598-554e-4cfa-9b10-3f093985a6a5 on network 981d1c8a-385a-4744-9bf1-eed77f908044 {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:12:43.064403 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 12, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:12:43.064906 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Checking segment: {'id': '803e39bb-16e7-471c-9371-b6d1deca6924', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '981d1c8a-385a-4744-9bf1-eed77f908044'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92568) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:12:43.072574 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:43.072574 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Bound using segment: {'id': '803e39bb-16e7-471c-9371-b6d1deca6924', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '981d1c8a-385a-4744-9bf1-eed77f908044'} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:12:43.072574 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Bound port: d2139598-554e-4cfa-9b10-3f093985a6a5, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '803e39bb-16e7-471c-9371-b6d1deca6924', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '981d1c8a-385a-4744-9bf1-eed77f908044'}}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:12:43.072574 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:43.190993 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] For port d2139598-554e-4cfa-9b10-3f093985a6a5, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92568) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:12:43.195257 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] For port d2139598-554e-4cfa-9b10-3f093985a6a5, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=d2139598-554e-4cfa-9b10-3f093985a6a5,segment=NetworkSegment(803e39bb-16e7-471c-9371-b6d1deca6924),segment_id=803e39bb-16e7-471c-9371-b6d1deca6924)] {{(pid=92568) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:12:43.239894 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:43.301591 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:43.303593 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:43.468794 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Routers {'0e328557-86fb-4850-b12b-8b85478844e6'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:12:43.469448 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe73485310>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:12:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['0e328557-86fb-4850-b12b-8b85478844e6'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:43.545752 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2acb9b27-670e-4e65-bc1b-79f6fa5037f8 req-88dec0d8-f0e6-4457-ac8b-7b68d2d2b42c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:43.559189 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2acb9b27-670e-4e65-bc1b-79f6fa5037f8 req-88dec0d8-f0e6-4457-ac8b-7b68d2d2b42c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.1358747
Jun 01 10:12:43.679975 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2acb9b27-670e-4e65-bc1b-79f6fa5037f8 req-83f38189-9b29-4f84-9c1d-f50c0b158513 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1197085
Jun 01 10:12:43.682174 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20547a9b-5e3f-43b8-bb0d-ba0a451f8398 None None] Pushing event updated for resources: {'Port': ['ID=d2139598-554e-4cfa-9b10-3f093985a6a5,revision_number=4']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:43.698513 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-20547a9b-5e3f-43b8-bb0d-ba0a451f8398 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.395s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:43.830986 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] Set router 0e328557-86fb-4850-b12b-8b85478844e6 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:12:44.039770 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:44.248074 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe73485310>, [{'id': '0e328557-86fb-4850-b12b-8b85478844e6', 'name': 'tempest-TestMinimumBasicScenario-1300067728-router', 'tenant_id': '9721bcf37577404fb3a206dac7fa327f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.228'}], 'enable_snat': True}, 'gw_port_id': '3fd04673-71e3-44bb-96f0-c953a4732ecf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:31Z', 'updated_at': '2021-06-01T10:12:38Z', 'revision_number': 4, 'project_id': '9721bcf37577404fb3a206dac7fa327f', 'gw_port': {'id': '3fd04673-71e3-44bb-96f0-c953a4732ecf', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:38:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e328557-86fb-4850-b12b-8b85478844e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:32Z', 'updated_at': '2021-06-01T10:12:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'd2139598-554e-4cfa-9b10-3f093985a6a5', 'name': '', 'network_id': '981d1c8a-385a-4744-9bf1-eed77f908044', 'tenant_id': '9721bcf37577404fb3a206dac7fa327f', 'mac_address': 'fa:16:3e:47:3d:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0e328557-86fb-4850-b12b-8b85478844e6', 'device_owner': 'network:router_interface', 'standard_attr_id': 481, 'fixed_ips': [{'subnet_id': '1e6ba067-5116-43a9-829c-16e65dbec6a4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:37Z', 'updated_at': '2021-06-01T10:12:43Z', 'revision_number': 4, 'project_id': '9721bcf37577404fb3a206dac7fa327f', 'subnets': [{'id': '1e6ba067-5116-43a9-829c-16e65dbec6a4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:12:44.254424 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57f38caa-1bf8-4c64-9eca-02cec9c27f1c None None] The sync data for ids ['0e328557-86fb-4850-b12b-8b85478844e6'] in dv-cinder-787262-4-iscsi is: [{'id': '0e328557-86fb-4850-b12b-8b85478844e6', 'name': 'tempest-TestMinimumBasicScenario-1300067728-router', 'tenant_id': '9721bcf37577404fb3a206dac7fa327f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.228'}], 'enable_snat': True}, 'gw_port_id': '3fd04673-71e3-44bb-96f0-c953a4732ecf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:31Z', 'updated_at': '2021-06-01T10:12:38Z', 'revision_number': 4, 'project_id': '9721bcf37577404fb3a206dac7fa327f', 'gw_port': {'id': '3fd04673-71e3-44bb-96f0-c953a4732ecf', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:38:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e328557-86fb-4850-b12b-8b85478844e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:32Z', 'updated_at': '2021-06-01T10:12:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'd2139598-554e-4cfa-9b10-3f093985a6a5', 'name': '', 'network_id': '981d1c8a-385a-4744-9bf1-eed77f908044', 'tenant_id': '9721bcf37577404fb3a206dac7fa327f', 'mac_address': 'fa:16:3e:47:3d:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0e328557-86fb-4850-b12b-8b85478844e6', 'device_owner': 'network:router_interface', 'standard_attr_id': 481, 'fixed_ips': [{'subnet_id': '1e6ba067-5116-43a9-829c-16e65dbec6a4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:37Z', 'updated_at': '2021-06-01T10:12:43Z', 'revision_number': 4, 'project_id': '9721bcf37577404fb3a206dac7fa327f', 'subnets': [{'id': '1e6ba067-5116-43a9-829c-16e65dbec6a4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:12:44.931542 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe886de3-e09a-4283-bce7-476a74e84778 req-08c849b5-995d-42bb-aae9-bb3b51e50bc2 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:44.933970 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fe886de3-e09a-4283-bce7-476a74e84778 req-08c849b5-995d-42bb-aae9-bb3b51e50bc2 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.0979161
Jun 01 10:12:44.948593 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-417ea36d-8457-4c41-b540-6dbcb76dcb6d req-d692948d-78f1-4906-a48e-04db92c46f87 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:44.950231 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-417ea36d-8457-4c41-b540-6dbcb76dcb6d req-d692948d-78f1-4906-a48e-04db92c46f87 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=f4f6f875519045a39c1fdbadd53ce517&device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 1098 time: 0.1675510
Jun 01 10:12:45.007058 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fe886de3-e09a-4283-bce7-476a74e84778 req-4d030cfb-366b-465c-939b-155818cc3f6a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0614822
Jun 01 10:12:45.218412 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-417ea36d-8457-4c41-b540-6dbcb76dcb6d req-1d55c1e9-3f9e-410f-940c-dea41cfea6f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:45.218412 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-417ea36d-8457-4c41-b540-6dbcb76dcb6d req-1d55c1e9-3f9e-410f-940c-dea41cfea6f8 service neutron] 10.222.0.30 "GET /v2.0/networks?id=be546533-cf92-483d-9e38-7d14ca9c4902 HTTP/1.1" status: 200  len: 917 time: 0.2573526
Jun 01 10:12:45.355899 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-417ea36d-8457-4c41-b540-6dbcb76dcb6d req-7423e534-9bb6-43ab-9e3c-f9d715315cf2 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=15ce50f0-fa11-464b-a55e-f6f214c49154 HTTP/1.1" status: 200  len: 1001 time: 0.1320710
Jun 01 10:12:45.463643 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-417ea36d-8457-4c41-b540-6dbcb76dcb6d req-d4437c13-bebc-42e0-855d-37142284bcbe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:45.465477 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-417ea36d-8457-4c41-b540-6dbcb76dcb6d req-d4437c13-bebc-42e0-855d-37142284bcbe service neutron] 10.222.0.30 "GET /v2.0/subnets?id=f2fdda64-a03c-41d7-8178-daca0363bd6e HTTP/1.1" status: 200  len: 855 time: 0.1024959
Jun 01 10:12:45.523404 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 36772) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:45.615647 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-417ea36d-8457-4c41-b540-6dbcb76dcb6d req-2af7bbe0-521f-4e73-b5f2-73291906e577 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:45.617173 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-417ea36d-8457-4c41-b540-6dbcb76dcb6d req-2af7bbe0-521f-4e73-b5f2-73291906e577 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=be546533-cf92-483d-9e38-7d14ca9c4902&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1409805
Jun 01 10:12:45.753783 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device d2139598-554e-4cfa-9b10-3f093985a6a5 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:12:45.792452 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c88797ad-3ef3-4f96-b22d-fd03cbe69d6d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:45.819954 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:45.845415 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-c88797ad-3ef3-4f96-b22d-fd03cbe69d6d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:12:45.851129 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-c88797ad-3ef3-4f96-b22d-fd03cbe69d6d admin admin] Usage tracker for resource:security_group_rule and tenant:61a38ac77773483093ea40863709e42c is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:12:45.856905 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-c88797ad-3ef3-4f96-b22d-fd03cbe69d6d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:12:45.870884 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-c88797ad-3ef3-4f96-b22d-fd03cbe69d6d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:12:45.888319 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-417ea36d-8457-4c41-b540-6dbcb76dcb6d req-899cba73-9c49-4c9f-912b-347e49d77014 service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2573323
Jun 01 10:12:45.965378 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port d2139598-554e-4cfa-9b10-3f093985a6a5 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:12:45.975529 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port d2139598-554e-4cfa-9b10-3f093985a6a5 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:45.975908 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:45.978340 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c88797ad-3ef3-4f96-b22d-fd03cbe69d6d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:46.034195 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c88797ad-3ef3-4f96-b22d-fd03cbe69d6d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:46.052609 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-417ea36d-8457-4c41-b540-6dbcb76dcb6d req-6d7448da-63c8-4163-9cec-c76266487b33 service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1531994
Jun 01 10:12:46.077287 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b72722ad-cefe-4476-9549-afa0778d76af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:46.112498 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-c88797ad-3ef3-4f96-b22d-fd03cbe69d6d admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=61a38ac77773483093ea40863709e42c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5855563
Jun 01 10:12:46.112498 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c88797ad-3ef3-4f96-b22d-fd03cbe69d6d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=baee452a-f5ba-4b97-81c1-1a2add5538a0,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:46.112970 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 36780) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:46.128155 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-c88797ad-3ef3-4f96-b22d-fd03cbe69d6d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:46.186047 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:46.201360 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f8beb0fc-257a-4075-a815-d2be12f664ab admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:46.236312 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port d2139598-554e-4cfa-9b10-3f093985a6a5, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=d2139598-554e-4cfa-9b10-3f093985a6a5,segment=NetworkSegment(803e39bb-16e7-471c-9371-b6d1deca6924),segment_id=803e39bb-16e7-471c-9371-b6d1deca6924)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:12:46.244750 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f8beb0fc-257a-4075-a815-d2be12f664ab admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:46.254177 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da029ba8-6f01-4991-b5ff-d58e5445e947 req-5e9714c5-d3eb-4bf2-ab5a-2d1754853870 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:46.256147 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-da029ba8-6f01-4991-b5ff-d58e5445e947 req-5e9714c5-d3eb-4bf2-ab5a-2d1754853870 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.1042607
Jun 01 10:12:46.332569 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-da029ba8-6f01-4991-b5ff-d58e5445e947 req-3bad8864-961d-49cc-a6a7-087e49e47106 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0705848
Jun 01 10:12:46.335164 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:46.337584 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:46.442280 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=d2139598-554e-4cfa-9b10-3f093985a6a5,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:46.445599 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:46.548333 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f8beb0fc-257a-4075-a815-d2be12f664ab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:46.553137 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-126332fa-8eba-4fb2-a6b0-36d2b3ae630f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:46.569330 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8beb0fc-257a-4075-a815-d2be12f664ab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=baee452a-f5ba-4b97-81c1-1a2add5538a0,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:46.572345 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f8beb0fc-257a-4075-a815-d2be12f664ab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:46.574714 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f8beb0fc-257a-4075-a815-d2be12f664ab admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:46.575881 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-f8beb0fc-257a-4075-a815-d2be12f664ab admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/baee452a-f5ba-4b97-81c1-1a2add5538a0 HTTP/1.1" status: 204  len: 168 time: 0.4613521
Jun 01 10:12:47.562136 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6441e821-94b3-48af-8806-483551c03c25 req-2bbfe49d-e078-439b-bed7-7d86d734a5bf tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:47.564168 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6441e821-94b3-48af-8806-483551c03c25 req-2bbfe49d-e078-439b-bed7-7d86d734a5bf tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.0908484
Jun 01 10:12:47.639596 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6441e821-94b3-48af-8806-483551c03c25 req-edc6072f-73df-4532-91a3-e44906dd3f2f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0659781
Jun 01 10:12:47.685416 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device d2139598-554e-4cfa-9b10-3f093985a6a5 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:12:47.774465 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port d2139598-554e-4cfa-9b10-3f093985a6a5 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:12:47.774966 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:47.788383 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 36804) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:47.812043 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a9782ece-6807-4b67-b60a-1015a0fa45e1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:47.854995 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-a9782ece-6807-4b67-b60a-1015a0fa45e1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:12:47.861169 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-a9782ece-6807-4b67-b60a-1015a0fa45e1 admin admin] Usage tracker for resource:security_group_rule and tenant:efe2b191ec084573bf2ac13b40ad4652 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:12:47.864926 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-a9782ece-6807-4b67-b60a-1015a0fa45e1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:12:47.873130 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-a9782ece-6807-4b67-b60a-1015a0fa45e1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:12:48.017615 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a9782ece-6807-4b67-b60a-1015a0fa45e1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:48.067941 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a9782ece-6807-4b67-b60a-1015a0fa45e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:48.078733 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c3a0879d-6f4f-4dd3-9ed8-7d5c1a9f2942 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:48.123250 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-a9782ece-6807-4b67-b60a-1015a0fa45e1 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=efe2b191ec084573bf2ac13b40ad4652&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3331017
Jun 01 10:12:48.124603 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9782ece-6807-4b67-b60a-1015a0fa45e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a8c1f7a7-dc44-4018-8b0a-987affd93451,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:48.126248 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 36810) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:48.129337 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a9782ece-6807-4b67-b60a-1015a0fa45e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:48.197077 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b26ba7d8-8c47-4adf-9132-8744c2ce5c82 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:48.229085 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b26ba7d8-8c47-4adf-9132-8744c2ce5c82 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:48.336613 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b26ba7d8-8c47-4adf-9132-8744c2ce5c82 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:48.340373 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-bd6fb4ba-0625-4a10-a7f8-59ca97f4a178 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:48.353949 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b26ba7d8-8c47-4adf-9132-8744c2ce5c82 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a8c1f7a7-dc44-4018-8b0a-987affd93451,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:48.356828 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b26ba7d8-8c47-4adf-9132-8744c2ce5c82 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:48.366109 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b26ba7d8-8c47-4adf-9132-8744c2ce5c82 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:48.368698 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-b26ba7d8-8c47-4adf-9132-8744c2ce5c82 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/a8c1f7a7-dc44-4018-8b0a-987affd93451 HTTP/1.1" status: 204  len: 168 time: 0.2414756
Jun 01 10:12:48.885357 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa705cbb-02a0-4e1f-8a7c-7b39208c6eab req-f4570eee-8b67-4b7b-a521-df50267b6914 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:48.887056 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa705cbb-02a0-4e1f-8a7c-7b39208c6eab req-f4570eee-8b67-4b7b-a521-df50267b6914 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 945 time: 0.1066620
Jun 01 10:12:48.963118 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fa705cbb-02a0-4e1f-8a7c-7b39208c6eab req-547cb450-d0af-4d13-a2ac-a0ebb94bb15c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0703967
Jun 01 10:12:48.979726 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 15ce50f0-fa11-464b-a55e-f6f214c49154 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:12:49.205197 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:49.262202 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0043671-b417-407f-944f-21d4e3af4137', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '15ce50f0-fa11-464b-a55e-f6f214c49154'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:12:49.264499 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be2abc07-d350-4e62-b019-77f9fc49dfd8" -d '{"events": [{"server_uuid": "e0043671-b417-407f-944f-21d4e3af4137", "name": "network-vif-unplugged", "status": "completed", "tag": "15ce50f0-fa11-464b-a55e-f6f214c49154"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:12:49.285675 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 15ce50f0-fa11-464b-a55e-f6f214c49154, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=15ce50f0-fa11-464b-a55e-f6f214c49154,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:12:49.371217 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:49.372993 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:49.487254 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=15ce50f0-fa11-464b-a55e-f6f214c49154,revision_number=8']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:49.492272 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:50.166855 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 01 Jun 2021 10:12:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3f1c03dc-29b3-4271-9230-bb930daa4efc x-openstack-request-id: req-3f1c03dc-29b3-4271-9230-bb930daa4efc {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:12:50.167477 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e0043671-b417-407f-944f-21d4e3af4137", "name": "network-vif-unplugged", "status": "failed", "tag": "15ce50f0-fa11-464b-a55e-f6f214c49154", "code": 422}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:12:50.167477 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-3f1c03dc-29b3-4271-9230-bb930daa4efc {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:12:50.168223 dv-cinder-787262-4-iscsi neutron-server[92567]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'e0043671-b417-407f-944f-21d4e3af4137', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '15ce50f0-fa11-464b-a55e-f6f214c49154', 'code': 422} returned with failed status
Jun 01 10:12:52.629313 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5efff0b4-00ae-48ed-876d-cdeb7a868457 req-802f4e3a-97b2-4a2a-a38f-4251a0b01845 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:52.631628 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5efff0b4-00ae-48ed-876d-cdeb7a868457 req-802f4e3a-97b2-4a2a-a38f-4251a0b01845 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.1222546
Jun 01 10:12:52.690660 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5efff0b4-00ae-48ed-876d-cdeb7a868457 req-17a6c855-e337-4efb-ae6c-d8eb1636a8ff tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0493624
Jun 01 10:12:52.850579 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-86422d86-bb13-4b89-9a02-33a2180305e3 req-323cbd2d-3238-46a3-b1a4-1ba3c5e8f737 service neutron] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1158891
Jun 01 10:12:53.907260 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffe07dbe-7fc1-4058-b347-407f345d53eb req-0f1176d0-60e3-4cc2-9d69-ad68acb6ca27 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:53.908825 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ffe07dbe-7fc1-4058-b347-407f345d53eb req-0f1176d0-60e3-4cc2-9d69-ad68acb6ca27 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.0981390
Jun 01 10:12:53.994048 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ffe07dbe-7fc1-4058-b347-407f345d53eb req-d2f9ee44-fac7-459f-8b93-1a968fa933c7 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0761709
Jun 01 10:12:54.837195 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86422d86-bb13-4b89-9a02-33a2180305e3 req-447de7e3-e40e-4d6f-a166-a68e29fe4375 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:54.837195 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-86422d86-bb13-4b89-9a02-33a2180305e3 req-447de7e3-e40e-4d6f-a166-a68e29fe4375 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137&tenant_id=f4f6f875519045a39c1fdbadd53ce517 HTTP/1.1" status: 200  len: 1096 time: 0.0875535
Jun 01 10:12:54.935794 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86422d86-bb13-4b89-9a02-33a2180305e3 req-debd8e73-61a1-48f7-a0bc-9f824b1bd623 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:54.937310 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-86422d86-bb13-4b89-9a02-33a2180305e3 req-debd8e73-61a1-48f7-a0bc-9f824b1bd623 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=f4f6f875519045a39c1fdbadd53ce517&device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 1096 time: 0.0709784
Jun 01 10:12:55.072702 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86422d86-bb13-4b89-9a02-33a2180305e3 req-0dafb82f-8a2b-4b5a-9240-bfa01630ed1e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:55.074074 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-86422d86-bb13-4b89-9a02-33a2180305e3 req-0dafb82f-8a2b-4b5a-9240-bfa01630ed1e service neutron] 10.222.0.30 "GET /v2.0/networks?id=be546533-cf92-483d-9e38-7d14ca9c4902 HTTP/1.1" status: 200  len: 917 time: 0.1300421
Jun 01 10:12:55.183363 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-86422d86-bb13-4b89-9a02-33a2180305e3 req-309e9de3-a4ae-4f0d-a0c0-495e5df7a7c9 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=15ce50f0-fa11-464b-a55e-f6f214c49154 HTTP/1.1" status: 200  len: 999 time: 0.0996299
Jun 01 10:12:55.261919 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86422d86-bb13-4b89-9a02-33a2180305e3 req-cfcbd74f-3084-4be2-9707-7c09e45580e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:55.263630 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-86422d86-bb13-4b89-9a02-33a2180305e3 req-cfcbd74f-3084-4be2-9707-7c09e45580e7 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=f2fdda64-a03c-41d7-8178-daca0363bd6e HTTP/1.1" status: 200  len: 855 time: 0.0738575
Jun 01 10:12:55.349015 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86422d86-bb13-4b89-9a02-33a2180305e3 req-2e8210e7-8aa4-414b-9e37-4b28d70258a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:55.350444 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-86422d86-bb13-4b89-9a02-33a2180305e3 req-2e8210e7-8aa4-414b-9e37-4b28d70258a8 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=be546533-cf92-483d-9e38-7d14ca9c4902&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0753806
Jun 01 10:12:55.364630 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb1a7b6e-644a-44e0-ae9b-c38edf80f6b9 req-36edc39d-e75b-48b2-b8fe-8976d97c8bb5 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:55.366127 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cb1a7b6e-644a-44e0-ae9b-c38edf80f6b9 req-36edc39d-e75b-48b2-b8fe-8976d97c8bb5 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.0865941
Jun 01 10:12:55.413015 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cb1a7b6e-644a-44e0-ae9b-c38edf80f6b9 req-01932c10-a566-45b8-b0ed-68924e0dc975 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406854
Jun 01 10:12:55.488964 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-86422d86-bb13-4b89-9a02-33a2180305e3 req-8f9d4db7-00a6-44df-a52f-c9113f4a5941 service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1280384
Jun 01 10:12:55.639561 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-86422d86-bb13-4b89-9a02-33a2180305e3 req-9a5a9347-6ad8-4958-94cc-4acaa3142b9e service neutron] 10.222.0.30 "GET /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1304083
Jun 01 10:12:56.182437 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f95f0c-b24d-4176-b277-222278324f76 req-96c86881-50f7-4533-8d01-3883dd2c29d3 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:56.183882 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a7f95f0c-b24d-4176-b277-222278324f76 req-96c86881-50f7-4533-8d01-3883dd2c29d3 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/networks?id=d11181a0-389a-4fe3-b44f-805e01bb81e5 HTTP/1.1" status: 200  len: 815 time: 0.1583321
Jun 01 10:12:56.200180 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a7f95f0c-b24d-4176-b277-222278324f76 req-d8d98d9a-1442-43a6-9a03-3c8bef564d47 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/quotas/42ccd1aa89a94252b32a254cead654ef HTTP/1.1" status: 200  len: 375 time: 0.0106685
Jun 01 10:12:56.298880 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a7f95f0c-b24d-4176-b277-222278324f76 req-89bc3a42-fe42-447e-b41f-db04861435df tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=42ccd1aa89a94252b32a254cead654ef&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0927813
Jun 01 10:12:56.546552 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:56.783602 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a7f95f0c-b24d-4176-b277-222278324f76 req-0176b132-2582-45fa-96ce-747fae4738c9 service neutron] 10.222.0.68 "GET /v2.0/networks/d11181a0-389a-4fe3-b44f-805e01bb81e5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4773288
Jun 01 10:12:56.946587 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62911f09-762b-466e-b5e7-1b659a297cb8 req-fa7957f1-3a31-4595-adcc-a9c5419818e4 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:56.948148 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-62911f09-762b-466e-b5e7-1b659a297cb8 req-fa7957f1-3a31-4595-adcc-a9c5419818e4 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.2221665
Jun 01 10:12:56.956623 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a7f95f0c-b24d-4176-b277-222278324f76 req-8a04f590-2ac5-4ef7-9838-5e6afe3de022 service neutron] 10.222.0.68 "GET /v2.0/networks/d11181a0-389a-4fe3-b44f-805e01bb81e5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1721373
Jun 01 10:12:57.016585 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-62911f09-762b-466e-b5e7-1b659a297cb8 req-ded538a6-f4b8-42bb-b846-060f75c9518e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0588334
Jun 01 10:12:57.215581 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-32935b65-9c6e-411e-bf8d-ba534952a25e req-e9e291bd-2b82-47e8-9f34-86b4c66a2593 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 210 time: 0.0451517
Jun 01 10:12:58.234927 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18786aef-c8b4-4b2c-9e59-6c2887bba8fb req-c89b79eb-cda3-4cce-9988-abd477159d92 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:58.237234 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-18786aef-c8b4-4b2c-9e59-6c2887bba8fb req-c89b79eb-cda3-4cce-9988-abd477159d92 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.0877917
Jun 01 10:12:58.336185 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8c5cc975-56e2-47ea-9929-9abc1e2a87f8 req-381dcf86-f83e-4c7f-9746-1aea9f97cfbc tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 210 time: 0.0548012
Jun 01 10:12:58.338984 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-18786aef-c8b4-4b2c-9e59-6c2887bba8fb req-85a733e7-4db7-4a87-805d-61ed0917ce1a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0911615
Jun 01 10:12:58.589625 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37036) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:58.712160 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-29d52c68-9e57-4146-9d66-1c44e46ac4a0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:58.735886 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-29d52c68-9e57-4146-9d66-1c44e46ac4a0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:12:58.740220 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-29d52c68-9e57-4146-9d66-1c44e46ac4a0 admin admin] Usage tracker for resource:security_group_rule and tenant:f79d296a6db243eaa47ffcddb514a19a is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:12:58.746376 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-29d52c68-9e57-4146-9d66-1c44e46ac4a0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:12:58.752675 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-29d52c68-9e57-4146-9d66-1c44e46ac4a0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:12:58.838111 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-29d52c68-9e57-4146-9d66-1c44e46ac4a0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:58.925135 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-29d52c68-9e57-4146-9d66-1c44e46ac4a0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:58.932694 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-de86292f-5250-406a-ba5c-cf342e4cfbd9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:58.983002 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-29d52c68-9e57-4146-9d66-1c44e46ac4a0 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=f79d296a6db243eaa47ffcddb514a19a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3922493
Jun 01 10:12:58.984237 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29d52c68-9e57-4146-9d66-1c44e46ac4a0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2808ac4b-14da-4ad8-8b7a-1025aef3815a,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:58.985815 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37042) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:12:58.988024 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-29d52c68-9e57-4146-9d66-1c44e46ac4a0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:59.065357 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4c657c63-6e9c-4424-9ce4-caedf49cddea admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:59.096280 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4c657c63-6e9c-4424-9ce4-caedf49cddea admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:59.227848 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4c657c63-6e9c-4424-9ce4-caedf49cddea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:59.235469 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-0842d006-14ac-42e6-81c0-382339330fd9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:12:59.249020 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c657c63-6e9c-4424-9ce4-caedf49cddea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2808ac4b-14da-4ad8-8b7a-1025aef3815a,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:12:59.252071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-4c657c63-6e9c-4424-9ce4-caedf49cddea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:12:59.254858 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4c657c63-6e9c-4424-9ce4-caedf49cddea admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:12:59.259886 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-4c657c63-6e9c-4424-9ce4-caedf49cddea admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/2808ac4b-14da-4ad8-8b7a-1025aef3815a HTTP/1.1" status: 204  len: 168 time: 0.2730231
Jun 01 10:12:59.565905 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a0782792-3142-494c-b6ec-e8f54fc08f39 req-76dfeb6b-b8d3-4031-bfd7-d24b5c1e5c5b tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 210 time: 0.0921130
Jun 01 10:12:59.618093 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d47dda85-28ef-403b-bc08-e548797170bf req-1d831c4e-67c3-4055-87bb-84f5e372a6be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:12:59.619899 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d47dda85-28ef-403b-bc08-e548797170bf req-1d831c4e-67c3-4055-87bb-84f5e372a6be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.1069872
Jun 01 10:12:59.678680 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d47dda85-28ef-403b-bc08-e548797170bf req-eae863a2-4743-4c8f-bf18-565dcc36b0c3 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0507936
Jun 01 10:13:00.019710 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37058) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:00.040840 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-788a8651-30fb-4f81-ab63-426a13eefc25 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:00.057449 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-788a8651-30fb-4f81-ab63-426a13eefc25 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:00.061919 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-788a8651-30fb-4f81-ab63-426a13eefc25 admin admin] Usage tracker for resource:security_group_rule and tenant:197745c7390b4c149b65a1a60340f5d2 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:00.064950 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-788a8651-30fb-4f81-ab63-426a13eefc25 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:00.070932 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-788a8651-30fb-4f81-ab63-426a13eefc25 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:00.164736 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-788a8651-30fb-4f81-ab63-426a13eefc25 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:00.233400 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-788a8651-30fb-4f81-ab63-426a13eefc25 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:00.241143 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-36255746-64f4-4012-9a77-517b011439fa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:00.283187 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-788a8651-30fb-4f81-ab63-426a13eefc25 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=197745c7390b4c149b65a1a60340f5d2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2622695
Jun 01 10:13:00.284025 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-788a8651-30fb-4f81-ab63-426a13eefc25 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c16d25bf-9e41-4043-898b-5bf0b513d5c9,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:00.285848 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37062) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:00.287027 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-788a8651-30fb-4f81-ab63-426a13eefc25 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:00.373840 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2c18e0d7-9d4f-4332-8283-c5b71159ce4d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:00.401710 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2c18e0d7-9d4f-4332-8283-c5b71159ce4d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:00.530652 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2c18e0d7-9d4f-4332-8283-c5b71159ce4d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:00.534593 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f373b84d-9171-4c2f-98fc-f6df3b931242 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:00.549119 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c18e0d7-9d4f-4332-8283-c5b71159ce4d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c16d25bf-9e41-4043-898b-5bf0b513d5c9,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:00.552632 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-2c18e0d7-9d4f-4332-8283-c5b71159ce4d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:00.562429 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2c18e0d7-9d4f-4332-8283-c5b71159ce4d admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:00.563603 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-2c18e0d7-9d4f-4332-8283-c5b71159ce4d admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/c16d25bf-9e41-4043-898b-5bf0b513d5c9 HTTP/1.1" status: 204  len: 168 time: 0.2759821
Jun 01 10:13:00.727300 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5f1f14d3-2158-4a83-a1de-384414db3916 req-98564b6c-170d-4c4d-a044-f4dc5191d90f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 210 time: 0.0491405
Jun 01 10:13:00.913726 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20f70093-c6d0-46be-9f8b-6fbbeb8ebb7a req-7ba952f6-81d9-4396-bbd7-36799167d791 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:00.914514 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-20f70093-c6d0-46be-9f8b-6fbbeb8ebb7a req-7ba952f6-81d9-4396-bbd7-36799167d791 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.0982988
Jun 01 10:13:00.968652 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-20f70093-c6d0-46be-9f8b-6fbbeb8ebb7a req-a51e3edf-1eb7-4043-ac53-a1aa09ff2481 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0462000
Jun 01 10:13:01.911558 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-67e14a2c-74b3-4102-8710-801c34087161 req-9ed79bd0-27e5-4bde-8094-ab705e18754a tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 210 time: 0.0550916
Jun 01 10:13:02.173360 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11f07b7d-e9f0-4a43-b580-9b42ffa9f5d7 req-547de1fc-3fc3-4b2e-ae00-a3e105803ea7 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:02.174828 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-11f07b7d-e9f0-4a43-b580-9b42ffa9f5d7 req-547de1fc-3fc3-4b2e-ae00-a3e105803ea7 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.0877633
Jun 01 10:13:02.229301 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-11f07b7d-e9f0-4a43-b580-9b42ffa9f5d7 req-8c391d3d-2c93-46f2-8f9c-69a2875bcc18 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0478661
Jun 01 10:13:03.107810 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-66194968-6473-4c3b-8286-bbb347c967d5 req-a8540d9c-1204-49ee-8731-7c6a357c2a34 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 210 time: 0.0775905
Jun 01 10:13:03.445127 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3e3e3f9-3aa2-471f-9ae1-046759cde1bf req-e0852df8-8346-4217-bd4c-7f6ce25314be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:03.446773 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b3e3e3f9-3aa2-471f-9ae1-046759cde1bf req-e0852df8-8346-4217-bd4c-7f6ce25314be tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.0952520
Jun 01 10:13:03.471707 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:13:03.493644 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b3e3e3f9-3aa2-471f-9ae1-046759cde1bf req-d9dc1b74-222e-494e-8401-a392b73b0f62 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0411992
Jun 01 10:13:04.268638 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0a0a9c10-f918-4bd5-8d95-6b623b9f7f9e req-ad898239-034e-4293-ba81-6f9307c5ffe9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 210 time: 0.0430615
Jun 01 10:13:04.717250 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ae262f0-84bc-4090-96bc-16555aef6b9f req-77b3d51c-b185-412a-9b5a-6b59778a0aec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:04.731552 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3ae262f0-84bc-4090-96bc-16555aef6b9f req-77b3d51c-b185-412a-9b5a-6b59778a0aec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.1031270
Jun 01 10:13:04.769497 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3ae262f0-84bc-4090-96bc-16555aef6b9f req-7eb9de38-4584-47de-a133-393800aefe38 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0441828
Jun 01 10:13:05.425460 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6d3a3c04-8436-45fe-baf2-ed3e8a0c831c req-cd63b8c0-14f9-431c-8e17-f741fd1b4396 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 210 time: 0.0462546
Jun 01 10:13:06.013834 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e6006e1-ac7a-46f1-956a-9502af0f9f7f req-301a347e-964b-445d-85d6-4b0fa81bb525 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:06.018177 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1e6006e1-ac7a-46f1-956a-9502af0f9f7f req-301a347e-964b-445d-85d6-4b0fa81bb525 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.1171796
Jun 01 10:13:06.072164 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1e6006e1-ac7a-46f1-956a-9502af0f9f7f req-80614a16-dae8-475b-8446-2a72b4d3627a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0481544
Jun 01 10:13:06.731897 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c45aa50a-1041-4714-b8e8-6d96d36801a9 req-893e5e5f-008b-491b-84fe-3bab589b31be tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 210 time: 0.0427639
Jun 01 10:13:07.263246 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4865ae13-1de8-4770-9ee9-eed99078d218 req-a17a313f-fdf9-474a-a103-6d56d7133b9e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:07.264790 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4865ae13-1de8-4770-9ee9-eed99078d218 req-a17a313f-fdf9-474a-a103-6d56d7133b9e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.0803206
Jun 01 10:13:07.313333 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4865ae13-1de8-4770-9ee9-eed99078d218 req-98540a21-6842-41a3-879d-c58460282154 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0429497
Jun 01 10:13:07.945838 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-338d8d66-1e4d-4beb-9578-24e56b387761 req-7e448223-f4c3-49ee-8394-ac15db4f9a5d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 210 time: 0.1087363
Jun 01 10:13:08.499520 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c25298d6-78aa-478f-9455-69ccd66b64c8 req-9f3cad69-38b3-4803-b012-da655138b942 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:08.500943 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c25298d6-78aa-478f-9455-69ccd66b64c8 req-9f3cad69-38b3-4803-b012-da655138b942 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.0799603
Jun 01 10:13:08.546726 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c25298d6-78aa-478f-9455-69ccd66b64c8 req-fde7e0ba-0a99-4fdf-831f-248576761670 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0401928
Jun 01 10:13:09.089682 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fc41aa8a-dfe6-4c17-9b78-5c8761df8c3b req-f5deabcc-54e3-4299-a1fe-19d0063de64b tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 210 time: 0.0424678
Jun 01 10:13:09.739193 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03a1d6ab-80ab-417a-b773-a8967bb07201 req-637dfedf-a915-4518-9bfd-3639747c516d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:09.740657 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-03a1d6ab-80ab-417a-b773-a8967bb07201 req-637dfedf-a915-4518-9bfd-3639747c516d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.0807598
Jun 01 10:13:09.791373 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-03a1d6ab-80ab-417a-b773-a8967bb07201 req-681d6af6-5205-41e6-8d2d-51a1cad5221f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0441151
Jun 01 10:13:10.236972 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-091a342d-f98e-4f69-8c5f-39153a127dae req-5f7a545f-8a49-43cd-8551-a70651136130 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 210 time: 0.0422509
Jun 01 10:13:10.471788 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-d536f6b3-8829-4545-a036-64beebb0eabc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:10.679913 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f95f0c-b24d-4176-b277-222278324f76 req-8235c13f-13f4-4f50-adba-a0cdc7a00d38 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:10.680596 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-a7f95f0c-b24d-4176-b277-222278324f76 req-8235c13f-13f4-4f50-adba-a0cdc7a00d38 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Synchronizing usage tracker for tenant:42ccd1aa89a94252b32a254cead654ef on resource:network {{(pid=92565) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:13:10.782296 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-a7f95f0c-b24d-4176-b277-222278324f76 req-8235c13f-13f4-4f50-adba-a0cdc7a00d38 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Unset dirty status for tenant:42ccd1aa89a94252b32a254cead654ef on resource:network {{(pid=92565) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:13:10.783469 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a7f95f0c-b24d-4176-b277-222278324f76 req-8235c13f-13f4-4f50-adba-a0cdc7a00d38 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.30 "GET /v2.0/networks?id=d11181a0-389a-4fe3-b44f-805e01bb81e5 HTTP/1.1" status: 200  len: 815 time: 0.2556119
Jun 01 10:13:10.808371 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [req-a7f95f0c-b24d-4176-b277-222278324f76 req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Request body: {'port': {'device_id': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5', 'admin_state_up': True, 'tenant_id': '42ccd1aa89a94252b32a254cead654ef'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:13:10.966189 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [req-a7f95f0c-b24d-4176-b277-222278324f76 req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:10.970448 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-a7f95f0c-b24d-4176-b277-222278324f76 req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Usage tracker for resource:port and tenant:42ccd1aa89a94252b32a254cead654ef is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:10.974034 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-a7f95f0c-b24d-4176-b277-222278324f76 req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Quota usage for port was recalculated. Used quota:2. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:10.981330 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [req-a7f95f0c-b24d-4176-b277-222278324f76 req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:10.999198 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41406c39-01a5-4df2-bcf3-f59c854f0a71 req-ed0c2e65-a1b8-46fd-a2e4-527b39628921 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:11.000680 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-41406c39-01a5-4df2-bcf3-f59c854f0a71 req-ed0c2e65-a1b8-46fd-a2e4-527b39628921 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 943 time: 0.0809636
Jun 01 10:13:11.046072 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a7f95f0c-b24d-4176-b277-222278324f76 req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Made reservation on behalf of 42ccd1aa89a94252b32a254cead654ef for: {'port': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:13:11.049879 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-a7f95f0c-b24d-4176-b277-222278324f76 req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:11.050475 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-41406c39-01a5-4df2-bcf3-f59c854f0a71 req-30de2d6b-5ebd-4951-a4f0-1931d7484473 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0417664
Jun 01 10:13:11.120053 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 15ce50f0-fa11-464b-a55e-f6f214c49154 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:13:11.264793 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [req-a7f95f0c-b24d-4176-b277-222278324f76 req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Allocated IP 172.20.0.11 (d11181a0-389a-4fe3-b44f-805e01bb81e5/dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9/14a54ac6-61b8-43e2-b571-8a9993ebd80c) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:13:11.292277 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 15ce50f0-fa11-464b-a55e-f6f214c49154, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=15ce50f0-fa11-464b-a55e-f6f214c49154,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:13:11.311507 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': '15ce50f0-fa11-464b-a55e-f6f214c49154', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'port_id': '15ce50f0-fa11-464b-a55e-f6f214c49154', 'mac_address': 'fa:16:3e:9f:c6:d9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 861, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:13:11.393210 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:11.411132 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-376a74f8-a732-4d6c-8e23-9a333a54a145 req-88eb5d4d-2d5e-4888-9193-f477857bd63a tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 210 time: 0.0568850
Jun 01 10:13:11.421544 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 15ce50f0-fa11-464b-a55e-f6f214c49154 {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:13:11.444381 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 15ce50f0-fa11-464b-a55e-f6f214c49154, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=15ce50f0-fa11-464b-a55e-f6f214c49154,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:13:11.513795 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:11.517541 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:11.602536 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=15ce50f0-fa11-464b-a55e-f6f214c49154,revision_number=9']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:11.606532 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:11.616290 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-a7f95f0c-b24d-4176-b277-222278324f76 req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:11.636695 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.provisioning_blocks [req-a7f95f0c-b24d-4176-b277-222278324f76 req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Transition to ACTIVE for port object 14a54ac6-61b8-43e2-b571-8a9993ebd80c will not be triggered until provisioned by entity DHCP. {{(pid=92565) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:13:11.778457 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['15ce50f0-fa11-464b-a55e-f6f214c49154'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:13:11.914184 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-a7f95f0c-b24d-4176-b277-222278324f76 req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:11.938406 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:12.077603 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a7f95f0c-b24d-4176-b277-222278324f76 req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Network d11181a0-389a-4fe3-b44f-805e01bb81e5 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:13:12.083372 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Pushing event updated for resources: {'Port': ['ID=14a54ac6-61b8-43e2-b571-8a9993ebd80c,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:12.098618 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [req-a7f95f0c-b24d-4176-b277-222278324f76 req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:13:12.122753 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:12.125387 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [req-a7f95f0c-b24d-4176-b277-222278324f76 req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:13:12.233918 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f95f0c-b24d-4176-b277-222278324f76 req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:12.234633 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-a7f95f0c-b24d-4176-b277-222278324f76 req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:12.350575 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2aa465-67e0-4351-abb7-488b28cdf1ac req-438cc109-ab56-4b49-a40a-de2686022953 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:12.352274 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8b2aa465-67e0-4351-abb7-488b28cdf1ac req-438cc109-ab56-4b49-a40a-de2686022953 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 944 time: 0.1005318
Jun 01 10:13:12.377265 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a7f95f0c-b24d-4176-b277-222278324f76 req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.5835471
Jun 01 10:13:12.412344 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8b2aa465-67e0-4351-abb7-488b28cdf1ac req-035147a1-1f38-4b12-935a-c156ae66a960 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0522835
Jun 01 10:13:12.502473 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-26b1ac67-7487-4caf-811f-6179f7b69557 None None] Provisioning for port 14a54ac6-61b8-43e2-b571-8a9993ebd80c completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:13:12.507807 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-26b1ac67-7487-4caf-811f-6179f7b69557 None None] Provisioning complete for port 14a54ac6-61b8-43e2-b571-8a9993ebd80c triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:13:12.508825 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-26b1ac67-7487-4caf-811f-6179f7b69557 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:12.580970 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-26b1ac67-7487-4caf-811f-6179f7b69557 None None] Port 14a54ac6-61b8-43e2-b571-8a9993ebd80c cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:13:12.660158 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b4d4163-0877-4a64-8a48-48585f21e80e req-a38a918a-2e09-4aef-9cf9-1dedd59b725c tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:12.661707 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8b4d4163-0877-4a64-8a48-48585f21e80e req-a38a918a-2e09-4aef-9cf9-1dedd59b725c tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 932 time: 0.0944507
Jun 01 10:13:12.715971 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8b4d4163-0877-4a64-8a48-48585f21e80e req-66f45dc8-c226-402e-83bf-d842e513fa8d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0484707
Jun 01 10:13:12.949790 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-ca2fb839-0d68-43d7-8c6c-1ea0d0637f15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:13.136078 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 15ce50f0-fa11-464b-a55e-f6f214c49154 up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:13:13.237837 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port 15ce50f0-fa11-464b-a55e-f6f214c49154 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:13:13.238220 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:13.372728 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:13.401770 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0043671-b417-407f-944f-21d4e3af4137', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '15ce50f0-fa11-464b-a55e-f6f214c49154'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:13:13.417013 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-16ee6187-a88b-4e38-b113-752c7d08cb88" -d '{"events": [{"server_uuid": "e0043671-b417-407f-944f-21d4e3af4137", "name": "network-vif-plugged", "status": "completed", "tag": "15ce50f0-fa11-464b-a55e-f6f214c49154"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:13:13.425013 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 15ce50f0-fa11-464b-a55e-f6f214c49154, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=15ce50f0-fa11-464b-a55e-f6f214c49154,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:13:13.475140 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:13:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-273fd2c9-b6b2-4d50-ab01-d37c63799695 x-openstack-request-id: req-273fd2c9-b6b2-4d50-ab01-d37c63799695 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:13:13.475140 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e0043671-b417-407f-944f-21d4e3af4137", "name": "network-vif-plugged", "status": "completed", "tag": "15ce50f0-fa11-464b-a55e-f6f214c49154", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:13:13.475140 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-273fd2c9-b6b2-4d50-ab01-d37c63799695 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:13:13.475140 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e0043671-b417-407f-944f-21d4e3af4137', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '15ce50f0-fa11-464b-a55e-f6f214c49154', 'code': 200}
Jun 01 10:13:13.535144 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:13.546518 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:13.555106 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-75d1443d-095c-4fc2-9900-951b4b0462a5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:13.633880 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d511e926-a559-40e1-8f80-7f82d47dc6ba req-5a877af9-a07f-496f-ba59-77aaa9244902 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:13.635465 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d511e926-a559-40e1-8f80-7f82d47dc6ba req-5a877af9-a07f-496f-ba59-77aaa9244902 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 946 time: 0.1061578
Jun 01 10:13:13.636307 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=15ce50f0-fa11-464b-a55e-f6f214c49154,revision_number=10']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:13.639540 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:13.691316 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d511e926-a559-40e1-8f80-7f82d47dc6ba req-f78df927-8958-424c-825f-62f72c73dc2f tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0497637
Jun 01 10:13:13.922540 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b27d0b7-ab8e-4fad-8ba7-0fd158e64c75 req-69711c59-1bb2-47fa-9f72-cb0f9c54ffac tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:13.924769 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8b27d0b7-ab8e-4fad-8ba7-0fd158e64c75 req-69711c59-1bb2-47fa-9f72-cb0f9c54ffac tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 932 time: 0.0903113
Jun 01 10:13:13.981307 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8b27d0b7-ab8e-4fad-8ba7-0fd158e64c75 req-c9dc9a00-3128-45bf-be0f-161ff61454b8 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0504894
Jun 01 10:13:14.227926 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:14.924686 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f41f3c4-6cf0-4eac-b1f0-27e8bd65d898 req-a4855cb1-7c06-4c2f-88ac-b6afe35c1487 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:14.927519 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9f41f3c4-6cf0-4eac-b1f0-27e8bd65d898 req-a4855cb1-7c06-4c2f-88ac-b6afe35c1487 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 946 time: 0.1107669
Jun 01 10:13:14.974024 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9f41f3c4-6cf0-4eac-b1f0-27e8bd65d898 req-3c4fbb70-47a7-45ce-a8b3-a2db86c74dd8 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0452752
Jun 01 10:13:15.239754 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fe7d615-55ff-491e-9637-d5ba55b62b41 req-e8aa0cfc-2018-469f-a23a-38b16113c732 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:15.239754 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6fe7d615-55ff-491e-9637-d5ba55b62b41 req-e8aa0cfc-2018-469f-a23a-38b16113c732 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 932 time: 0.0873237
Jun 01 10:13:15.239754 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6fe7d615-55ff-491e-9637-d5ba55b62b41 req-95bf9c24-94c8-4da0-a357-d8541f85dde1 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425029
Jun 01 10:13:15.704537 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37270) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:15.830044 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6c4a1807-6d9a-4a87-a652-08ae36e4e3f2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:15.839330 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:15.845685 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6c4a1807-6d9a-4a87-a652-08ae36e4e3f2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:15.849661 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6c4a1807-6d9a-4a87-a652-08ae36e4e3f2 admin admin] Usage tracker for resource:security_group_rule and tenant:4ced919f83084272afcdae5f0dba7f62 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:15.862350 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6c4a1807-6d9a-4a87-a652-08ae36e4e3f2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:15.862350 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6c4a1807-6d9a-4a87-a652-08ae36e4e3f2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:15.958786 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6c4a1807-6d9a-4a87-a652-08ae36e4e3f2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:16.176541 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a3fa3e0-2cec-4d69-86c7-9d580b07c3ab req-f6996335-3012-47a1-b478-0e28b6605f5d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:16.178069 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4a3fa3e0-2cec-4d69-86c7-9d580b07c3ab req-f6996335-3012-47a1-b478-0e28b6605f5d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 946 time: 0.0852752
Jun 01 10:13:16.225250 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4a3fa3e0-2cec-4d69-86c7-9d580b07c3ab req-31b6966b-6e13-4560-816c-11fe9df7d197 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0411992
Jun 01 10:13:16.284615 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6c4a1807-6d9a-4a87-a652-08ae36e4e3f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:16.293105 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-45f789bd-5080-40a0-8872-96ec702e3b0b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:16.339240 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c4a1807-6d9a-4a87-a652-08ae36e4e3f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e8305e00-d0bc-4d3b-946b-8baee027a089,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:16.357173 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6c4a1807-6d9a-4a87-a652-08ae36e4e3f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:16.369559 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37280) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:16.373633 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-6c4a1807-6d9a-4a87-a652-08ae36e4e3f2 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=4ced919f83084272afcdae5f0dba7f62&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6690164
Jun 01 10:13:16.453780 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:16.475606 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5440681-4ff1-46c6-b0df-e68ddd9de62a req-75606e1a-86d9-4b92-892f-ce8f6020864f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:16.478336 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f5440681-4ff1-46c6-b0df-e68ddd9de62a req-75606e1a-86d9-4b92-892f-ce8f6020864f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 932 time: 0.1012471
Jun 01 10:13:16.483561 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:16.531878 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f5440681-4ff1-46c6-b0df-e68ddd9de62a req-0f4f79a7-6a38-4f1e-be60-675ef76d9ec5 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0470614
Jun 01 10:13:16.626446 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:16.631676 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-3e9eac9d-2ae8-412a-b1c5-0713b90403e5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:16.646015 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8305e00-d0bc-4d3b-946b-8baee027a089,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:16.654239 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:16.655460 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/e8305e00-d0bc-4d3b-946b-8baee027a089 HTTP/1.1" status: 204  len: 168 time: 0.2842319
Jun 01 10:13:16.657371 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:16.659695 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:16.660023 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:16.660396 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:16.660764 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:16.661129 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:16.661478 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:16.661839 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:16.662198 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:16.662549 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:16.662897 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:16.663264 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:16.671655 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:17.458739 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d079f5bd-64a2-40b2-bd96-c0d42233e75e req-92288245-30fb-4d1b-92dc-75488a5239e8 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:17.461240 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d079f5bd-64a2-40b2-bd96-c0d42233e75e req-92288245-30fb-4d1b-92dc-75488a5239e8 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 946 time: 0.0951896
Jun 01 10:13:17.514353 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d079f5bd-64a2-40b2-bd96-c0d42233e75e req-de6ee8df-f2c3-4ebe-aff4-31ec883ec5f4 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0464439
Jun 01 10:13:17.751741 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2420f4c-4862-4f0a-a1f7-4d733c7d1e5c req-30b9e498-fa00-4a56-8d6d-65a4bee651cd tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:17.755629 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c2420f4c-4862-4f0a-a1f7-4d733c7d1e5c req-30b9e498-fa00-4a56-8d6d-65a4bee651cd tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 932 time: 0.0919788
Jun 01 10:13:17.814747 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c2420f4c-4862-4f0a-a1f7-4d733c7d1e5c req-d783a991-9c1a-4fdf-8774-a5cade04fe37 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0520973
Jun 01 10:13:18.806685 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71bccd85-7fd7-4b71-abec-57b87ac972dd req-7313b299-f937-47ce-8987-0475b3d2d05e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:18.808489 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-71bccd85-7fd7-4b71-abec-57b87ac972dd req-7313b299-f937-47ce-8987-0475b3d2d05e tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 946 time: 0.1705661
Jun 01 10:13:18.871477 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-71bccd85-7fd7-4b71-abec-57b87ac972dd req-a0e40a04-3d7b-43b0-95a0-3d1ac404c756 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0555589
Jun 01 10:13:19.029273 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a8d988d-3ad0-4552-9052-809b927de3d4 req-0f4fdb5f-164b-4dc2-a626-d159a19739c9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:19.030790 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8a8d988d-3ad0-4552-9052-809b927de3d4 req-0f4fdb5f-164b-4dc2-a626-d159a19739c9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 932 time: 0.0900192
Jun 01 10:13:19.083132 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8a8d988d-3ad0-4552-9052-809b927de3d4 req-64029db4-2e76-4d0f-9029-ca549d1114db tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0461721
Jun 01 10:13:19.365189 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37340) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:19.545975 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:19.641877 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:19.646233 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Usage tracker for resource:security_group_rule and tenant:5d42f1a70b544659a718f015be51554d is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:19.649449 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:19.656430 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:19.740516 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:19.867921 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:19.876114 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b56321ab-6771-4a46-8097-3f2a1a937f52 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:19.933892 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37350) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:19.934487 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=5d42f1a70b544659a718f015be51554d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5678849
Jun 01 10:13:19.935216 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d7a2767-3b17-42bc-9131-31e4e00e74f1,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:19.953784 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:19.954152 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:19.954514 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:19.954891 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:19.955262 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:19.955617 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:19.955963 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:19.956308 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:19.956656 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:19.957018 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:19.957381 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:19.963146 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:19.974734 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:20.012831 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b8477aa3-592d-4b86-a03f-d254baa75bb7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:20.043078 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b8477aa3-592d-4b86-a03f-d254baa75bb7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:20.164466 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f34bae-3f53-4170-8dba-88a3ebbceee1 req-138b6d9d-1293-40b1-9664-b9ed424242ad tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:20.166171 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a4f34bae-3f53-4170-8dba-88a3ebbceee1 req-138b6d9d-1293-40b1-9664-b9ed424242ad tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 946 time: 0.1230180
Jun 01 10:13:20.173470 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b8477aa3-592d-4b86-a03f-d254baa75bb7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:20.181457 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-e77a2567-9d63-405e-8f83-d029af64c683 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:20.195500 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8477aa3-592d-4b86-a03f-d254baa75bb7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d7a2767-3b17-42bc-9131-31e4e00e74f1,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:20.199227 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b8477aa3-592d-4b86-a03f-d254baa75bb7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:20.205082 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b8477aa3-592d-4b86-a03f-d254baa75bb7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:20.209162 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-b8477aa3-592d-4b86-a03f-d254baa75bb7 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/8d7a2767-3b17-42bc-9131-31e4e00e74f1 HTTP/1.1" status: 204  len: 168 time: 0.2740207
Jun 01 10:13:20.313831 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a4f34bae-3f53-4170-8dba-88a3ebbceee1 req-672521b9-9ccd-41c1-8290-e547705cf922 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1408834
Jun 01 10:13:20.358489 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a429e5d-018a-458a-8901-69cdbb108096 req-b9ab587d-cad8-4358-9266-54a10fd5271f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:20.360559 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3a429e5d-018a-458a-8901-69cdbb108096 req-b9ab587d-cad8-4358-9266-54a10fd5271f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 932 time: 0.1573994
Jun 01 10:13:20.411876 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3a429e5d-018a-458a-8901-69cdbb108096 req-07d4d954-a666-4660-a56d-d571db90558f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0442982
Jun 01 10:13:21.516756 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dd66913-d8d4-4cbf-997f-8af80f9a62dc req-a2b85a20-c0be-48a1-8ce8-fe75be36e6c3 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:21.518234 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7dd66913-d8d4-4cbf-997f-8af80f9a62dc req-a2b85a20-c0be-48a1-8ce8-fe75be36e6c3 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 946 time: 0.0843956
Jun 01 10:13:21.608801 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7dd66913-d8d4-4cbf-997f-8af80f9a62dc req-62103c28-466f-4466-adf5-8a2700bc082b tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0849073
Jun 01 10:13:21.635277 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9845559-4e6f-4480-9048-c5933ab9f187 req-840c9654-1ae3-46b7-b641-2e974d676e18 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:21.636706 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a9845559-4e6f-4480-9048-c5933ab9f187 req-840c9654-1ae3-46b7-b641-2e974d676e18 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 932 time: 0.1000574
Jun 01 10:13:21.683472 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a9845559-4e6f-4480-9048-c5933ab9f187 req-4cd7899e-b503-4b3c-8d94-0cce23044377 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411417
Jun 01 10:13:21.846812 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Request body: {'port': {'device_id': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:13:21.958687 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:22.280219 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59630868-7948-4bc7-aa32-2534b7769154 req-8c4e8cde-9a0d-4738-80f6-30907f8aee01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:22.281694 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-59630868-7948-4bc7-aa32-2534b7769154 req-8c4e8cde-9a0d-4738-80f6-30907f8aee01 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 1099 time: 0.0716987
Jun 01 10:13:22.327809 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-59630868-7948-4bc7-aa32-2534b7769154 req-69493ca6-d7a4-49fe-aa91-37a421035eeb service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0346625
Jun 01 10:13:22.331546 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 14a54ac6-61b8-43e2-b571-8a9993ebd80c {{(pid=92565) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:13:22.339534 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:22.353564 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.provisioning_blocks [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Transition to ACTIVE for port object 14a54ac6-61b8-43e2-b571-8a9993ebd80c will not be triggered until provisioned by entity L2. {{(pid=92565) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:13:22.421606 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2295697'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:22.425352 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-ffc4eda1-822a-40f4-ada2-166faeaaf259 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:22.586314 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Pushing event updated for resources: {'Port': ['ID=14a54ac6-61b8-43e2-b571-8a9993ebd80c,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:22.594350 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:22.670768 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Attempting to bind port 14a54ac6-61b8-43e2-b571-8a9993ebd80c on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:13:22.671141 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Attempting to bind port 14a54ac6-61b8-43e2-b571-8a9993ebd80c by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '4888209f-5226-40f1-b206-246370701bbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5'}] {{(pid=92565) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:13:22.671474 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Attempting to bind port 14a54ac6-61b8-43e2-b571-8a9993ebd80c on network d11181a0-389a-4fe3-b44f-805e01bb81e5 {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:13:22.676069 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Port 14a54ac6-61b8-43e2-b571-8a9993ebd80c on network d11181a0-389a-4fe3-b44f-805e01bb81e5 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:13:22.676336 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Attempting to bind port 14a54ac6-61b8-43e2-b571-8a9993ebd80c on network d11181a0-389a-4fe3-b44f-805e01bb81e5 {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:13:22.681454 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 12, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:13:22.681795 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Checking segment: {'id': '4888209f-5226-40f1-b206-246370701bbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92565) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:13:22.682186 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Bound using segment: {'id': '4888209f-5226-40f1-b206-246370701bbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5'} {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:13:22.682616 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Bound port: 14a54ac6-61b8-43e2-b571-8a9993ebd80c, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4888209f-5226-40f1-b206-246370701bbd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5'}}] {{(pid=92565) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:13:22.682992 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:22.773033 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] For port 14a54ac6-61b8-43e2-b571-8a9993ebd80c, host hv-cinder-78726, cleared binding levels {{(pid=92565) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:13:22.776616 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] For port 14a54ac6-61b8-43e2-b571-8a9993ebd80c, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=14a54ac6-61b8-43e2-b571-8a9993ebd80c,segment=NetworkSegment(4888209f-5226-40f1-b206-246370701bbd),segment_id=4888209f-5226-40f1-b206-246370701bbd)] {{(pid=92565) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:13:22.854048 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4ead51-fb7b-4bc2-9ac2-6ad7551a1713 req-5e60a21c-52c1-4da9-897b-34441d0cbc36 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:22.855585 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fe4ead51-fb7b-4bc2-9ac2-6ad7551a1713 req-5e60a21c-52c1-4da9-897b-34441d0cbc36 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 946 time: 0.1311231
Jun 01 10:13:22.856843 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2295697'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:22.860900 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:22.921051 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fe4ead51-fb7b-4bc2-9ac2-6ad7551a1713 req-70f69861-2f89-4309-bc78-88b5d92f39dd tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0596404
Jun 01 10:13:22.925624 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:22.926310 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:22.927649 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a7f95f0c-b24d-4176-b277-222278324f76 req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] 10.222.0.30 "PUT /v2.0/ports/14a54ac6-61b8-43e2-b571-8a9993ebd80c HTTP/1.1" status: 200  len: 1094 time: 1.0855291
Jun 01 10:13:22.928160 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'tag': '14a54ac6-61b8-43e2-b571-8a9993ebd80c'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:13:22.930478 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fce635fe-9837-4227-ad59-13e2a33edf7c" -d '{"events": [{"name": "network-changed", "server_uuid": "c52836ef-4dc8-4dd2-a679-e9d0cbeaa489", "tag": "14a54ac6-61b8-43e2-b571-8a9993ebd80c"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:13:22.945383 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Pushing event updated for resources: {'Port': ['ID=14a54ac6-61b8-43e2-b571-8a9993ebd80c,revision_number=3']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:22.958034 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c0d4c33-9f0f-4325-b213-24086f72a99b req-7ab7679c-88e4-4939-bd8a-040fde5fa434 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:22.958034 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9c0d4c33-9f0f-4325-b213-24086f72a99b req-7ab7679c-88e4-4939-bd8a-040fde5fa434 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 944 time: 0.1331112
Jun 01 10:13:22.958427 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:22.997176 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:13:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dfc2b12e-14a8-4d2b-aa2b-0a506502a0de x-openstack-request-id: req-dfc2b12e-14a8-4d2b-aa2b-0a506502a0de {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:13:22.997520 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c52836ef-4dc8-4dd2-a679-e9d0cbeaa489", "tag": "14a54ac6-61b8-43e2-b571-8a9993ebd80c", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:13:22.997697 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9c0d4c33-9f0f-4325-b213-24086f72a99b req-06af0c36-6c55-41dc-9623-94fe545a7a1d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436945
Jun 01 10:13:22.997820 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-dfc2b12e-14a8-4d2b-aa2b-0a506502a0de {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:13:22.998231 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'tag': '14a54ac6-61b8-43e2-b571-8a9993ebd80c', 'status': 'completed', 'code': 200}
Jun 01 10:13:23.093317 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fce635fe-9837-4227-ad59-13e2a33edf7c req-c0c2c0cc-5010-4473-bb8e-310c4c7fd0cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:23.094830 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-fce635fe-9837-4227-ad59-13e2a33edf7c req-c0c2c0cc-5010-4473-bb8e-310c4c7fd0cf service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=42ccd1aa89a94252b32a254cead654ef&device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 1097 time: 0.0746343
Jun 01 10:13:23.249700 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fce635fe-9837-4227-ad59-13e2a33edf7c req-c016ee8b-17d8-413a-a07f-2e18dbce63ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:23.251102 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-fce635fe-9837-4227-ad59-13e2a33edf7c req-c016ee8b-17d8-413a-a07f-2e18dbce63ed service neutron] 10.222.0.30 "GET /v2.0/networks?tenant_id=42ccd1aa89a94252b32a254cead654ef&shared=False HTTP/1.1" status: 200  len: 916 time: 0.1452885
Jun 01 10:13:23.416425 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-01653bc6-009b-4294-82d5-dace03a4616c req-929d40b0-9024-4fbf-bbfb-5318cda87241 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1221924
Jun 01 10:13:23.540753 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01653bc6-009b-4294-82d5-dace03a4616c req-c8178fe2-8929-4ee1-a962-bb376263de53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:23.542396 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-01653bc6-009b-4294-82d5-dace03a4616c req-c8178fe2-8929-4ee1-a962-bb376263de53 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 1099 time: 0.1025300
Jun 01 10:13:23.578079 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fce635fe-9837-4227-ad59-13e2a33edf7c req-2054fb01-1452-4996-a82f-616ad96a9075 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:23.579645 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-fce635fe-9837-4227-ad59-13e2a33edf7c req-2054fb01-1452-4996-a82f-616ad96a9075 service neutron] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.3201039
Jun 01 10:13:23.714957 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f95f0c-b24d-4176-b277-222278324f76 req-acd8cf15-a6fd-4ebe-86b8-654570498cd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:23.717115 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a7f95f0c-b24d-4176-b277-222278324f76 req-acd8cf15-a6fd-4ebe-86b8-654570498cd4 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=42ccd1aa89a94252b32a254cead654ef&device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 1097 time: 0.0964789
Jun 01 10:13:23.754468 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01653bc6-009b-4294-82d5-dace03a4616c req-c7eaa4e2-f0f4-4eaa-833a-1e2cde512f66 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:23.756269 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-01653bc6-009b-4294-82d5-dace03a4616c req-c7eaa4e2-f0f4-4eaa-833a-1e2cde512f66 service neutron] 10.222.0.30 "GET /v2.0/networks?id=83aff072-8820-4a36-b8f3-036a7011aace HTTP/1.1" status: 200  len: 910 time: 0.1862526
Jun 01 10:13:23.792772 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a7f95f0c-b24d-4176-b277-222278324f76 req-68ebd6c4-a03e-4739-9b2f-833b38d9cca1 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=14a54ac6-61b8-43e2-b571-8a9993ebd80c HTTP/1.1" status: 200  len: 217 time: 0.0680394
Jun 01 10:13:23.861472 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f95f0c-b24d-4176-b277-222278324f76 req-537d05a7-085b-4420-aa31-ce94e45c46d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:23.862971 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a7f95f0c-b24d-4176-b277-222278324f76 req-537d05a7-085b-4420-aa31-ce94e45c46d8 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9 HTTP/1.1" status: 200  len: 854 time: 0.0643773
Jun 01 10:13:23.865662 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-01653bc6-009b-4294-82d5-dace03a4616c req-953f16ec-fc6d-4058-83e9-6bdfc6887dd4 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=435c6b97-3648-4e27-92c7-12447506ef9f HTTP/1.1" status: 200  len: 1002 time: 0.1025109
Jun 01 10:13:23.929391 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01653bc6-009b-4294-82d5-dace03a4616c req-3316db18-e112-4667-a94e-fe874a1506c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:23.930817 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-01653bc6-009b-4294-82d5-dace03a4616c req-3316db18-e112-4667-a94e-fe874a1506c3 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=38dbf18a-9bde-4c4a-b149-d02ad12671d3 HTTP/1.1" status: 200  len: 848 time: 0.0570176
Jun 01 10:13:23.955099 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f95f0c-b24d-4176-b277-222278324f76 req-baa63751-2bd1-49c0-8aae-9e856515605e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:23.957279 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a7f95f0c-b24d-4176-b277-222278324f76 req-baa63751-2bd1-49c0-8aae-9e856515605e service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=d11181a0-389a-4fe3-b44f-805e01bb81e5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0836267
Jun 01 10:13:24.020520 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01653bc6-009b-4294-82d5-dace03a4616c req-5e2b2041-e058-4cfb-aa77-c518b1a97883 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:24.022668 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-01653bc6-009b-4294-82d5-dace03a4616c req-5e2b2041-e058-4cfb-aa77-c518b1a97883 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=83aff072-8820-4a36-b8f3-036a7011aace&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0846767
Jun 01 10:13:24.169697 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a7f95f0c-b24d-4176-b277-222278324f76 req-4507992f-556b-4ddb-936f-516fb6c7fa16 service neutron] 10.222.0.30 "GET /v2.0/networks/d11181a0-389a-4fe3-b44f-805e01bb81e5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1970663
Jun 01 10:13:24.295633 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-01653bc6-009b-4294-82d5-dace03a4616c req-0c8193d6-721f-4ef4-8292-5e17ee12cec5 service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2668660
Jun 01 10:13:24.307639 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-a7f95f0c-b24d-4176-b277-222278324f76 req-032121c9-83c2-4899-93d3-c79343e3305e service neutron] 10.222.0.30 "GET /v2.0/networks/d11181a0-389a-4fe3-b44f-805e01bb81e5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1321528
Jun 01 10:13:24.341648 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87646a3f-c885-4e18-a7e0-faff36634e08 req-e6569e9f-1e69-48d6-9b25-9c502b55e35c tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:24.343125 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87646a3f-c885-4e18-a7e0-faff36634e08 req-e6569e9f-1e69-48d6-9b25-9c502b55e35c tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 944 time: 0.1822689
Jun 01 10:13:24.352178 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e870e9d-5101-43b4-8260-45c4f93bc36a req-36a31ec6-e30c-469a-b593-0383687ff8d3 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:24.353574 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5e870e9d-5101-43b4-8260-45c4f93bc36a req-36a31ec6-e30c-469a-b593-0383687ff8d3 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 946 time: 0.2407453
Jun 01 10:13:24.573002 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-87646a3f-c885-4e18-a7e0-faff36634e08 req-77258c9e-1b4a-4668-9371-7c2c3a8738a0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2178445
Jun 01 10:13:24.587380 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5e870e9d-5101-43b4-8260-45c4f93bc36a req-8acd7baa-91dd-42b6-b264-96435fbabcb3 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1054344
Jun 01 10:13:24.612491 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-01653bc6-009b-4294-82d5-dace03a4616c req-6c083e2b-e034-41b0-9ac2-0c100fe1351d service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3081570
Jun 01 10:13:25.760822 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ad3bbf-df25-4656-b324-5fb6c2fb4e46 req-58abf83d-141a-4c69-b999-a3c0345f148d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:25.762289 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-89ad3bbf-df25-4656-b324-5fb6c2fb4e46 req-58abf83d-141a-4c69-b999-a3c0345f148d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 944 time: 0.0825882
Jun 01 10:13:25.807051 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-89ad3bbf-df25-4656-b324-5fb6c2fb4e46 req-f13f97b2-7bcd-4901-96b2-3182727c7660 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382979
Jun 01 10:13:25.992928 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-093cd798-d7a5-48ac-8f95-65dd7ef96248 req-c00cbce9-adeb-43e4-8379-69222c8b5c8c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:25.994374 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-093cd798-d7a5-48ac-8f95-65dd7ef96248 req-c00cbce9-adeb-43e4-8379-69222c8b5c8c tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 946 time: 0.0877571
Jun 01 10:13:26.083693 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-093cd798-d7a5-48ac-8f95-65dd7ef96248 req-c1065193-1bf3-4997-bd26-a747f32c2c65 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0834060
Jun 01 10:13:26.113085 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de610fbb-9a26-4ebd-bd91-48acb9764c02 req-e6c4cc39-f63a-4404-92bc-1334ef655ecc tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:26.114791 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-de610fbb-9a26-4ebd-bd91-48acb9764c02 req-e6c4cc39-f63a-4404-92bc-1334ef655ecc tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 946 time: 0.0967224
Jun 01 10:13:26.158821 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-de610fbb-9a26-4ebd-bd91-48acb9764c02 req-3607b768-43c8-49b8-abe9-9c8db27abe5b tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=0500c211-3c38-4c74-b22c-0c81d01aa31a&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0383990
Jun 01 10:13:26.519253 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:26.993327 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a09fc62d-537a-4860-be58-93c3bc4850f4 req-0660527b-8393-497a-8716-76c656b988d8 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:26.995296 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a09fc62d-537a-4860-be58-93c3bc4850f4 req-0660527b-8393-497a-8716-76c656b988d8 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 944 time: 0.0821409
Jun 01 10:13:27.038697 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a09fc62d-537a-4860-be58-93c3bc4850f4 req-c4546894-5ffa-41f1-a22d-4a06b9624841 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0375311
Jun 01 10:13:27.228077 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 14a54ac6-61b8-43e2-b571-8a9993ebd80c details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:13:27.345406 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df749356-665e-4734-940e-d6e313de5e7d req-caffebed-4dde-4283-907c-5dfdad14e03f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:27.346864 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-df749356-665e-4734-940e-d6e313de5e7d req-caffebed-4dde-4283-907c-5dfdad14e03f tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 946 time: 0.0790036
Jun 01 10:13:27.386948 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 14a54ac6-61b8-43e2-b571-8a9993ebd80c, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=14a54ac6-61b8-43e2-b571-8a9993ebd80c,segment=NetworkSegment(4888209f-5226-40f1-b206-246370701bbd),segment_id=4888209f-5226-40f1-b206-246370701bbd)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:13:27.396760 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-df749356-665e-4734-940e-d6e313de5e7d req-d4af44bf-451f-447d-a880-a3deb1d9e612 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=0500c211-3c38-4c74-b22c-0c81d01aa31a&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.0440009
Jun 01 10:13:27.400505 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': '14a54ac6-61b8-43e2-b571-8a9993ebd80c', 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5', 'port_id': '14a54ac6-61b8-43e2-b571-8a9993ebd80c', 'mac_address': 'fa:16:3e:a1:65:d7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 868, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:13:27.454201 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:27.471304 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 14a54ac6-61b8-43e2-b571-8a9993ebd80c {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:13:27.487047 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 14a54ac6-61b8-43e2-b571-8a9993ebd80c, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=14a54ac6-61b8-43e2-b571-8a9993ebd80c,segment=NetworkSegment(4888209f-5226-40f1-b206-246370701bbd),segment_id=4888209f-5226-40f1-b206-246370701bbd)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:13:27.552897 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:27.554773 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-e749928b-302e-422f-8a6f-f4513c715aea None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:27.623550 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=14a54ac6-61b8-43e2-b571-8a9993ebd80c,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:27.630653 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:27.631024 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:27.631355 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:27.631680 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:27.631996 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:27.632311 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:27.632623 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:27.632935 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:27.633250 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:27.633558 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:27.633866 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:27.634173 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:13:27.637770 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:27.795026 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07d3b48c-4714-4613-95eb-d637e584a1fc req-73f8d48c-bdc3-4601-ac72-a336d33f46ab tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:27.796432 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-07d3b48c-4714-4613-95eb-d637e584a1fc req-73f8d48c-bdc3-4601-ac72-a336d33f46ab tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.30 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 946 time: 0.0797911
Jun 01 10:13:27.809523 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['14a54ac6-61b8-43e2-b571-8a9993ebd80c'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:13:27.944838 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-07d3b48c-4714-4613-95eb-d637e584a1fc req-873c479e-f1a6-40cf-9449-bcb913969704 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Deleting port 9206018f-e096-4bbf-be0f-57a111993b66 {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:13:27.945182 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-07d3b48c-4714-4613-95eb-d637e584a1fc req-873c479e-f1a6-40cf-9449-bcb913969704 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:28.076741 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-07d3b48c-4714-4613-95eb-d637e584a1fc req-873c479e-f1a6-40cf-9449-bcb913969704 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] For port 9206018f-e096-4bbf-be0f-57a111993b66, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=9206018f-e096-4bbf-be0f-57a111993b66,segment=NetworkSegment(2f350557-5423-4a12-a64b-0bf55f2578e6),segment_id=2f350557-5423-4a12-a64b-0bf55f2578e6)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:13:28.077325 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-07d3b48c-4714-4613-95eb-d637e584a1fc req-873c479e-f1a6-40cf-9449-bcb913969704 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:28.399917 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f18fd9cf-f32c-44ef-a53d-d3f2c5a7e6b8 req-6563c5bd-373d-40c0-8cf1-12fdedce87f7 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:28.401311 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f18fd9cf-f32c-44ef-a53d-d3f2c5a7e6b8 req-6563c5bd-373d-40c0-8cf1-12fdedce87f7 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 945 time: 0.2518153
Jun 01 10:13:28.459667 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-07d3b48c-4714-4613-95eb-d637e584a1fc req-873c479e-f1a6-40cf-9449-bcb913969704 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:28.460035 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-07d3b48c-4714-4613-95eb-d637e584a1fc req-873c479e-f1a6-40cf-9449-bcb913969704 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:28.460346 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.l3_db [req-07d3b48c-4714-4613-95eb-d637e584a1fc req-873c479e-f1a6-40cf-9449-bcb913969704 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Floating IP 80b14f4c-e062-4b26-9907-90fc498878e2 disassociated. External IP: 172.27.2.112, port: 9206018f-e096-4bbf-be0f-57a111993b66.
Jun 01 10:13:28.460682 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-07d3b48c-4714-4613-95eb-d637e584a1fc req-873c479e-f1a6-40cf-9449-bcb913969704 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Calling delete_port for 9206018f-e096-4bbf-be0f-57a111993b66 owned by compute:nova {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:13:28.468425 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f18fd9cf-f32c-44ef-a53d-d3f2c5a7e6b8 req-f5229fad-cdf7-44cb-a928-5ef6f613df1b tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0561147
Jun 01 10:13:28.642211 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ed113a9-9ff6-48d7-a686-fe741580b417 req-c06dd780-714d-4085-8510-5dd964eae658 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:28.643740 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8ed113a9-9ff6-48d7-a686-fe741580b417 req-c06dd780-714d-4085-8510-5dd964eae658 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 946 time: 0.1391437
Jun 01 10:13:28.679106 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-07d3b48c-4714-4613-95eb-d637e584a1fc req-873c479e-f1a6-40cf-9449-bcb913969704 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:28.688751 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-fb39e99f-0faf-40d9-87c8-cf378e029f00 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:28.812647 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8ed113a9-9ff6-48d7-a686-fe741580b417 req-e2e73956-f41c-4750-b30c-43b14d16124b tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups?id=0500c211-3c38-4c74-b22c-0c81d01aa31a&fields=id&fields=name HTTP/1.1" status: 200  len: 311 time: 0.1631708
Jun 01 10:13:28.820143 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-873c479e-f1a6-40cf-9449-bcb913969704 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event deleted for resources: {'Port': ['ID=9206018f-e096-4bbf-be0f-57a111993b66,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:28.824026 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-873c479e-f1a6-40cf-9449-bcb913969704 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:29.004632 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [req-07d3b48c-4714-4613-95eb-d637e584a1fc req-873c479e-f1a6-40cf-9449-bcb913969704 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Router d0653611-f9db-4b67-b4b2-4c0789fb691f has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92566) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:13:29.181672 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-07d3b48c-4714-4613-95eb-d637e584a1fc req-873c479e-f1a6-40cf-9449-bcb913969704 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:13:29.191857 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa06fd5a-0e86-4f9b-9642-46cb99fcb9c6 None None] Sync routers for ids ['d0653611-f9db-4b67-b4b2-4c0789fb691f'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:13:29.202030 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa06fd5a-0e86-4f9b-9642-46cb99fcb9c6 None None] Routers {'d0653611-f9db-4b67-b4b2-4c0789fb691f'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:13:29.202633 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-fa06fd5a-0e86-4f9b-9642-46cb99fcb9c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72800700>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:13:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d0653611-f9db-4b67-b4b2-4c0789fb691f'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:29.260580 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-07d3b48c-4714-4613-95eb-d637e584a1fc req-873c479e-f1a6-40cf-9449-bcb913969704 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] No DVR routers for this DVR port 9206018f-e096-4bbf-be0f-57a111993b66 on host hv-cinder-78726 {{(pid=92566) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:13:29.261667 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 14a54ac6-61b8-43e2-b571-8a9993ebd80c up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:13:29.262655 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-07d3b48c-4714-4613-95eb-d637e584a1fc req-873c479e-f1a6-40cf-9449-bcb913969704 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:29.265504 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3d232d55-724b-4a23-aa21-e4bdea0e204a', 'name': 'network-vif-deleted', 'tag': '9206018f-e096-4bbf-be0f-57a111993b66'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:13:29.268222 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d27ef374-9a0b-42ab-bb0f-ed8ff296638d" -d '{"events": [{"server_uuid": "3d232d55-724b-4a23-aa21-e4bdea0e204a", "name": "network-vif-deleted", "tag": "9206018f-e096-4bbf-be0f-57a111993b66"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:13:29.364275 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-07d3b48c-4714-4613-95eb-d637e584a1fc req-873c479e-f1a6-40cf-9449-bcb913969704 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.30 "DELETE /v2.0/ports/9206018f-e096-4bbf-be0f-57a111993b66 HTTP/1.1" status: 204  len: 173 time: 1.5619788
Jun 01 10:13:29.447814 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:13:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c133b7dc-15ce-407f-bfc0-85acc283aba5 x-openstack-request-id: req-c133b7dc-15ce-407f-bfc0-85acc283aba5 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:13:29.448135 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3d232d55-724b-4a23-aa21-e4bdea0e204a", "name": "network-vif-deleted", "tag": "9206018f-e096-4bbf-be0f-57a111993b66", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:13:29.448412 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-c133b7dc-15ce-407f-bfc0-85acc283aba5 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:13:29.448833 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3d232d55-724b-4a23-aa21-e4bdea0e204a', 'name': 'network-vif-deleted', 'tag': '9206018f-e096-4bbf-be0f-57a111993b66', 'status': 'completed', 'code': 200}
Jun 01 10:13:29.449270 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-fa06fd5a-0e86-4f9b-9642-46cb99fcb9c6 None None] Set router d0653611-f9db-4b67-b4b2-4c0789fb691f gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:13:29.508655 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port 14a54ac6-61b8-43e2-b571-8a9993ebd80c completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:13:29.516065 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port 14a54ac6-61b8-43e2-b571-8a9993ebd80c triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:13:29.516382 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:29.662243 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2ddb271-de8f-403a-b2df-f93826f5d348 req-7104dae5-f0cc-47ec-a658-527d83235d35 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:29.664611 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f2ddb271-de8f-403a-b2df-f93826f5d348 req-7104dae5-f0cc-47ec-a658-527d83235d35 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 945 time: 0.0851164
Jun 01 10:13:29.710518 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f2ddb271-de8f-403a-b2df-f93826f5d348 req-d56a3444-ce4a-4c5e-9c0d-5606a3f7dc78 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398598
Jun 01 10:13:29.808782 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:29.866997 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '14a54ac6-61b8-43e2-b571-8a9993ebd80c'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:13:29.869749 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5bd4fd30-87b2-4af0-8778-8161c33b8954" -d '{"events": [{"server_uuid": "c52836ef-4dc8-4dd2-a679-e9d0cbeaa489", "name": "network-vif-plugged", "status": "completed", "tag": "14a54ac6-61b8-43e2-b571-8a9993ebd80c"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:13:29.882880 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 14a54ac6-61b8-43e2-b571-8a9993ebd80c, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=14a54ac6-61b8-43e2-b571-8a9993ebd80c,segment=NetworkSegment(4888209f-5226-40f1-b206-246370701bbd),segment_id=4888209f-5226-40f1-b206-246370701bbd)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:13:29.905626 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-fa06fd5a-0e86-4f9b-9642-46cb99fcb9c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72800700>, [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:10Z', 'revision_number': 4, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71', 'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'mac_address': 'fa:16:3e:a9:83:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:23Z', 'revision_number': 5, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'subnets': [{'id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:29.910162 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa06fd5a-0e86-4f9b-9642-46cb99fcb9c6 None None] Checking router: d0653611-f9db-4b67-b4b2-4c0789fb691f for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:13:29.917812 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:13:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b4799e55-6ecc-4d6a-b739-d54914eefc6b x-openstack-request-id: req-b4799e55-6ecc-4d6a-b739-d54914eefc6b {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:13:29.918110 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c52836ef-4dc8-4dd2-a679-e9d0cbeaa489", "name": "network-vif-plugged", "status": "completed", "tag": "14a54ac6-61b8-43e2-b571-8a9993ebd80c", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:13:29.918367 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-b4799e55-6ecc-4d6a-b739-d54914eefc6b {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:13:29.918753 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '14a54ac6-61b8-43e2-b571-8a9993ebd80c', 'code': 200}
Jun 01 10:13:29.921453 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa06fd5a-0e86-4f9b-9642-46cb99fcb9c6 None None] Routers {'d0653611-f9db-4b67-b4b2-4c0789fb691f'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:13:29.922067 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-fa06fd5a-0e86-4f9b-9642-46cb99fcb9c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72800700>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:13:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d0653611-f9db-4b67-b4b2-4c0789fb691f'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:29.979197 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:29.985198 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-0250b726-44ba-44c1-a8bd-32e3d9c73e4b req-ca4fa538-e09c-4604-96b5-cdfb03904cac tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Synchronizing usage tracker for tenant:d13dc1de700d428a8982ca87f11948d0 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:13:29.988167 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-c1a5ece1-8767-49f2-b112-fd84e232645b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:30.079261 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-0250b726-44ba-44c1-a8bd-32e3d9c73e4b req-ca4fa538-e09c-4604-96b5-cdfb03904cac tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Unset dirty status for tenant:d13dc1de700d428a8982ca87f11948d0 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:13:30.081069 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0250b726-44ba-44c1-a8bd-32e3d9c73e4b req-ca4fa538-e09c-4604-96b5-cdfb03904cac tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/ports?device_id=3d232d55-724b-4a23-aa21-e4bdea0e204a HTTP/1.1" status: 200  len: 210 time: 0.1413715
Jun 01 10:13:30.146014 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=14a54ac6-61b8-43e2-b571-8a9993ebd80c,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:30.150928 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:30.171304 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-fa06fd5a-0e86-4f9b-9642-46cb99fcb9c6 None None] Set router d0653611-f9db-4b67-b4b2-4c0789fb691f gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:13:30.283452 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb25b931-933e-4f11-8b7e-951191ac976d req-57d4e397-72d9-4f17-90de-4f95c9135bb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:30.284916 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bb25b931-933e-4f11-8b7e-951191ac976d req-57d4e397-72d9-4f17-90de-4f95c9135bb6 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 1099 time: 0.0754123
Jun 01 10:13:30.331837 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bb25b931-933e-4f11-8b7e-951191ac976d req-0e31f05c-eddc-4633-b96f-a5c94e8b8d15 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0361857
Jun 01 10:13:30.524603 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-fa06fd5a-0e86-4f9b-9642-46cb99fcb9c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72800700>, [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:10Z', 'revision_number': 4, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71', 'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'mac_address': 'fa:16:3e:a9:83:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:23Z', 'revision_number': 5, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'subnets': [{'id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:30.529130 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa06fd5a-0e86-4f9b-9642-46cb99fcb9c6 None None] The sync data for ids ['d0653611-f9db-4b67-b4b2-4c0789fb691f'] in dv-cinder-787262-4-iscsi is: [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:06:10Z', 'revision_number': 4, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71', 'name': '', 'network_id': '3d9ff4d3-b145-4108-a593-976a9cfb63dc', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'mac_address': 'fa:16:3e:a9:83:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:23Z', 'revision_number': 5, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'subnets': [{'id': '2a00a573-a4bb-4d2d-a3e6-7aef03966618', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:13:30.736730 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7e1b4c9-7bb3-4612-9047-62c68eacbf26 None None] New status for floating IP 80b14f4c-e062-4b26-9907-90fc498878e2: DOWN {{(pid=92568) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:13:30.900908 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f3dc221-29d7-4cdf-b614-91fd3e7b9f97 req-415918b7-4773-4106-9fa8-c2afb1ebbf3a tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:30.900908 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5f3dc221-29d7-4cdf-b614-91fd3e7b9f97 req-415918b7-4773-4106-9fa8-c2afb1ebbf3a tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 946 time: 0.0838966
Jun 01 10:13:30.949934 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5f3dc221-29d7-4cdf-b614-91fd3e7b9f97 req-d38b64ba-b8d7-474d-b9e4-560c8226c072 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0432754
Jun 01 10:13:31.237765 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 9206018f-e096-4bbf-be0f-57a111993b66 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:13:31.272351 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: 9206018f-e096-4bbf-be0f-57a111993b66 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:13:31.272696 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 9206018f-e096-4bbf-be0f-57a111993b66 not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:13:31.280694 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37468) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:31.347883 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-caaa64b6-5fa6-458f-b1c8-acfae40e3edd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:31.376325 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-caaa64b6-5fa6-458f-b1c8-acfae40e3edd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:31.575711 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-caaa64b6-5fa6-458f-b1c8-acfae40e3edd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:31.579740 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-bd0e3008-415e-404e-9294-7feaaea9d898 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:31.593688 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caaa64b6-5fa6-458f-b1c8-acfae40e3edd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0500c211-3c38-4c74-b22c-0c81d01aa31a,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:31.597288 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-caaa64b6-5fa6-458f-b1c8-acfae40e3edd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:31.602477 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-caaa64b6-5fa6-458f-b1c8-acfae40e3edd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:31.604927 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-caaa64b6-5fa6-458f-b1c8-acfae40e3edd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "DELETE /v2.0/security-groups/0500c211-3c38-4c74-b22c-0c81d01aa31a HTTP/1.1" status: 204  len: 168 time: 0.3225720
Jun 01 10:13:31.607105 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37472) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:31.624780 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.api.v2.resource [None req-f3fbf672-e7b3-4646-bd69-abba42abec35 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] show failed (client error): The resource could not be found.
Jun 01 10:13:31.625773 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-f3fbf672-e7b3-4646-bd69-abba42abec35 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "GET /v2.0/security-groups/0500c211-3c38-4c74-b22c-0c81d01aa31a HTTP/1.1" status: 404  len: 347 time: 0.0177741
Jun 01 10:13:31.628655 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37476) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:31.850958 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-08235197-c9f7-4d85-a123-78857561a270 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Deleting port 802c8745-3b6c-4cd6-b5df-c981b1a002c7 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:13:31.851231 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-08235197-c9f7-4d85-a123-78857561a270 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:31.971558 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-08235197-c9f7-4d85-a123-78857561a270 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:31.971885 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-08235197-c9f7-4d85-a123-78857561a270 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:32.096889 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-08235197-c9f7-4d85-a123-78857561a270 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Calling delete_port for 802c8745-3b6c-4cd6-b5df-c981b1a002c7 owned by network:floatingip {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:13:32.140190 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66592572-3761-4616-9d0c-78c2262005ee req-051c36f4-f38d-4f56-95a9-8b69d77bd1fe tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:32.141577 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-66592572-3761-4616-9d0c-78c2262005ee req-051c36f4-f38d-4f56-95a9-8b69d77bd1fe tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 946 time: 0.0789979
Jun 01 10:13:32.189572 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-66592572-3761-4616-9d0c-78c2262005ee req-ef1d79f1-4e71-4e4f-88c8-31fa6d0953ad tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0424554
Jun 01 10:13:32.279035 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-08235197-c9f7-4d85-a123-78857561a270 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:32.283916 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-0e240795-85db-499a-b6bf-4108d5409117 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:32.330305 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08235197-c9f7-4d85-a123-78857561a270 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Pushing event deleted for resources: {'Port': ['ID=802c8745-3b6c-4cd6-b5df-c981b1a002c7,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:32.333424 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-08235197-c9f7-4d85-a123-78857561a270 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:32.381813 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c5eea7d-30be-44c8-be7b-b60fcd2a3cee req-868ba74f-88b1-4e0e-a791-8ea6a54b8b02 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:32.383322 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6c5eea7d-30be-44c8-be7b-b60fcd2a3cee req-868ba74f-88b1-4e0e-a791-8ea6a54b8b02 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 946 time: 0.0821559
Jun 01 10:13:32.421465 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-08235197-c9f7-4d85-a123-78857561a270 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks [] for floatingip, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:32.428917 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6c5eea7d-30be-44c8-be7b-b60fcd2a3cee req-e073c166-fe21-4cb2-abaf-6e566af0979c tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391948
Jun 01 10:13:32.519672 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-08235197-c9f7-4d85-a123-78857561a270 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:32.520889 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-08235197-c9f7-4d85-a123-78857561a270 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] 10.222.0.68 "DELETE /v2.0/floatingips/80b14f4c-e062-4b26-9907-90fc498878e2 HTTP/1.1" status: 204  len: 168 time: 0.8913045
Jun 01 10:13:32.967004 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8565028e-8e1f-41d2-a6f6-f07ef22ab966 req-fb26534a-4674-45be-af52-7e83e016378b tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:32.968346 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8565028e-8e1f-41d2-a6f6-f07ef22ab966 req-fb26534a-4674-45be-af52-7e83e016378b tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 946 time: 0.0848429
Jun 01 10:13:33.012541 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8565028e-8e1f-41d2-a6f6-f07ef22ab966 req-da017cf4-58a0-4614-aaff-d214732a5833 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383749
Jun 01 10:13:34.581169 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b3604f-9369-45de-aa6c-6bbab8a06ddc req-680ee9fe-3b98-4865-9bf8-31b35ae847d8 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:34.582643 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a6b3604f-9369-45de-aa6c-6bbab8a06ddc req-680ee9fe-3b98-4865-9bf8-31b35ae847d8 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 946 time: 0.0802565
Jun 01 10:13:34.630531 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a6b3604f-9369-45de-aa6c-6bbab8a06ddc req-5591801c-467b-47ce-a6da-c8e235776fd4 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0421343
Jun 01 10:13:35.829761 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6122dc3-c898-45b4-9938-1eae13e332a4 req-9b050155-51de-4d6e-bc06-671972621f70 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:35.831238 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f6122dc3-c898-45b4-9938-1eae13e332a4 req-9b050155-51de-4d6e-bc06-671972621f70 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 946 time: 0.0853465
Jun 01 10:13:35.877221 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f6122dc3-c898-45b4-9938-1eae13e332a4 req-889c7f20-e188-4bbf-be23-2ba1b13131b3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0403669
Jun 01 10:13:36.085573 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de8342ef-1b66-4a3a-b91a-4ed178b01fc3 req-8cdbe18a-326b-4660-9cc8-521261543db3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:36.087070 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-de8342ef-1b66-4a3a-b91a-4ed178b01fc3 req-8cdbe18a-326b-4660-9cc8-521261543db3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.30 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 946 time: 0.0821145
Jun 01 10:13:36.232308 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-de8342ef-1b66-4a3a-b91a-4ed178b01fc3 req-2893c268-ede8-425f-814e-25e1e3e4e388 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Deleting port 435c6b97-3648-4e27-92c7-12447506ef9f {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:13:36.232790 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-de8342ef-1b66-4a3a-b91a-4ed178b01fc3 req-2893c268-ede8-425f-814e-25e1e3e4e388 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:36.448890 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-de8342ef-1b66-4a3a-b91a-4ed178b01fc3 req-2893c268-ede8-425f-814e-25e1e3e4e388 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] For port 435c6b97-3648-4e27-92c7-12447506ef9f, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=435c6b97-3648-4e27-92c7-12447506ef9f,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:13:36.449290 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-de8342ef-1b66-4a3a-b91a-4ed178b01fc3 req-2893c268-ede8-425f-814e-25e1e3e4e388 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:36.738348 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-de8342ef-1b66-4a3a-b91a-4ed178b01fc3 req-2893c268-ede8-425f-814e-25e1e3e4e388 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:36.739019 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-de8342ef-1b66-4a3a-b91a-4ed178b01fc3 req-2893c268-ede8-425f-814e-25e1e3e4e388 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:36.739338 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.l3_db [req-de8342ef-1b66-4a3a-b91a-4ed178b01fc3 req-2893c268-ede8-425f-814e-25e1e3e4e388 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Floating IP 30889bd5-5712-4195-ae97-644587fcd5a3 disassociated. External IP: 172.27.2.247, port: 435c6b97-3648-4e27-92c7-12447506ef9f.
Jun 01 10:13:36.739674 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-de8342ef-1b66-4a3a-b91a-4ed178b01fc3 req-2893c268-ede8-425f-814e-25e1e3e4e388 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Calling delete_port for 435c6b97-3648-4e27-92c7-12447506ef9f owned by compute:nova {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:13:36.919329 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-de8342ef-1b66-4a3a-b91a-4ed178b01fc3 req-2893c268-ede8-425f-814e-25e1e3e4e388 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:36.926027 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-8b552f05-4fe7-4517-af11-33ac1afe44d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:36.977300 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2893c268-ede8-425f-814e-25e1e3e4e388 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event deleted for resources: {'Port': ['ID=435c6b97-3648-4e27-92c7-12447506ef9f,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:36.977469 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37546) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:36.980572 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-2893c268-ede8-425f-814e-25e1e3e4e388 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:37.101956 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bf454db8-5387-48fb-868a-a8be5beae746 req-fadae5c0-47ef-43b0-8081-cadb19786fc9 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 210 time: 0.0617127
Jun 01 10:13:37.211863 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [req-de8342ef-1b66-4a3a-b91a-4ed178b01fc3 req-2893c268-ede8-425f-814e-25e1e3e4e388 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Router 426524f6-17bf-45cb-b42b-2fec9e039ff0 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92566) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:13:37.416977 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-de8342ef-1b66-4a3a-b91a-4ed178b01fc3 req-2893c268-ede8-425f-814e-25e1e3e4e388 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:13:37.427465 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8984f3fc-d342-414d-9fcc-bf18970908ad None None] Sync routers for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:13:37.445048 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8984f3fc-d342-414d-9fcc-bf18970908ad None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:13:37.446048 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-8984f3fc-d342-414d-9fcc-bf18970908ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72642b20>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:13:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:37.498793 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-de8342ef-1b66-4a3a-b91a-4ed178b01fc3 req-2893c268-ede8-425f-814e-25e1e3e4e388 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] No DVR routers for this DVR port 435c6b97-3648-4e27-92c7-12447506ef9f on host hv-cinder-78726 {{(pid=92566) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:13:37.501607 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-de8342ef-1b66-4a3a-b91a-4ed178b01fc3 req-2893c268-ede8-425f-814e-25e1e3e4e388 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:37.506709 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4a01bc46-d5a0-4ef7-9aff-f160ee9d943f', 'name': 'network-vif-deleted', 'tag': '435c6b97-3648-4e27-92c7-12447506ef9f'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:13:37.509257 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c475b682-458a-49ca-ae4c-785ef00d3b9c" -d '{"events": [{"server_uuid": "4a01bc46-d5a0-4ef7-9aff-f160ee9d943f", "name": "network-vif-deleted", "tag": "435c6b97-3648-4e27-92c7-12447506ef9f"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:13:37.558756 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:13:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fe3d75fd-d55b-4f04-80d6-d00beb91044f x-openstack-request-id: req-fe3d75fd-d55b-4f04-80d6-d00beb91044f {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:13:37.559617 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4a01bc46-d5a0-4ef7-9aff-f160ee9d943f", "name": "network-vif-deleted", "tag": "435c6b97-3648-4e27-92c7-12447506ef9f", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:13:37.560205 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-fe3d75fd-d55b-4f04-80d6-d00beb91044f {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:13:37.560357 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4a01bc46-d5a0-4ef7-9aff-f160ee9d943f', 'name': 'network-vif-deleted', 'tag': '435c6b97-3648-4e27-92c7-12447506ef9f', 'status': 'completed', 'code': 200}
Jun 01 10:13:37.611633 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-de8342ef-1b66-4a3a-b91a-4ed178b01fc3 req-2893c268-ede8-425f-814e-25e1e3e4e388 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.30 "DELETE /v2.0/ports/435c6b97-3648-4e27-92c7-12447506ef9f HTTP/1.1" status: 204  len: 173 time: 1.5192006
Jun 01 10:13:37.668077 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-8984f3fc-d342-414d-9fcc-bf18970908ad None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:13:37.872351 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b62dcd54-0c49-4ad8-a436-7865bd61fd84 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-401846'] for router_interface, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:38.164899 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-8984f3fc-d342-414d-9fcc-bf18970908ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72642b20>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:38.172063 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8984f3fc-d342-414d-9fcc-bf18970908ad None None] Checking router: 426524f6-17bf-45cb-b42b-2fec9e039ff0 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:13:38.193982 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8984f3fc-d342-414d-9fcc-bf18970908ad None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:13:38.194608 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-8984f3fc-d342-414d-9fcc-bf18970908ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72642b20>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:13:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:38.292372 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-4cdc54e4-2402-4a66-9895-93e68c174068 req-fce97b99-350d-435b-9a36-ab3957d23285 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Synchronizing usage tracker for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:13:38.320706 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-b62dcd54-0c49-4ad8-a436-7865bd61fd84 admin admin] Deleting port 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:13:38.321263 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b62dcd54-0c49-4ad8-a436-7865bd61fd84 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:38.364943 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-4cdc54e4-2402-4a66-9895-93e68c174068 req-fce97b99-350d-435b-9a36-ab3957d23285 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Unset dirty status for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:13:38.366678 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4cdc54e4-2402-4a66-9895-93e68c174068 req-fce97b99-350d-435b-9a36-ab3957d23285 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=4a01bc46-d5a0-4ef7-9aff-f160ee9d943f HTTP/1.1" status: 200  len: 210 time: 0.1218982
Jun 01 10:13:38.390921 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-8984f3fc-d342-414d-9fcc-bf18970908ad None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:13:38.444651 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-b62dcd54-0c49-4ad8-a436-7865bd61fd84 admin admin] For port 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71,segment=NetworkSegment(2f350557-5423-4a12-a64b-0bf55f2578e6),segment_id=2f350557-5423-4a12-a64b-0bf55f2578e6)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:13:38.445041 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b62dcd54-0c49-4ad8-a436-7865bd61fd84 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:38.572628 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-b62dcd54-0c49-4ad8-a436-7865bd61fd84 admin admin] Calling delete_port for 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 owned by network:router_interface {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:13:38.746150 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-8984f3fc-d342-414d-9fcc-bf18970908ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72642b20>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:38.751979 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8984f3fc-d342-414d-9fcc-bf18970908ad None None] The sync data for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi is: [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:13:38.987067 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-463cbbbc-a693-4311-996a-9d1122c27f5d None None] New status for floating IP 30889bd5-5712-4195-ae97-644587fcd5a3: DOWN {{(pid=92568) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:13:39.027540 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b62dcd54-0c49-4ad8-a436-7865bd61fd84 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:39.031539 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c000dd5b-b548-49fc-9261-8d61b38c562e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:39.076468 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b62dcd54-0c49-4ad8-a436-7865bd61fd84 admin admin] Pushing event deleted for resources: {'Port': ['ID=7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:39.080011 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b62dcd54-0c49-4ad8-a436-7865bd61fd84 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:39.309513 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 435c6b97-3648-4e27-92c7-12447506ef9f no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:13:39.343664 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: 435c6b97-3648-4e27-92c7-12447506ef9f {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:13:39.344021 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 435c6b97-3648-4e27-92c7-12447506ef9f not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:13:39.349193 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b62dcd54-0c49-4ad8-a436-7865bd61fd84 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7875317', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-405030'] for router_interface, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:39.739438 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b62dcd54-0c49-4ad8-a436-7865bd61fd84 admin admin] Router d0653611-f9db-4b67-b4b2-4c0789fb691f has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:13:39.876576 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddd341da-483a-442f-8421-3b8d86f63095 req-bfa93b3c-0bbf-4862-864a-7325025f21ab tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-881588482&fields=id&tenant_id=cfa9132b1ba044548228b96f6c2755eb HTTP/1.1" status: 200  len: 267 time: 0.0412586
Jun 01 10:13:39.926619 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b62dcd54-0c49-4ad8-a436-7865bd61fd84 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:13:39.936076 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb417e3e-73a9-490a-ba81-1ca8a82a3d1d None None] Sync routers for ids ['d0653611-f9db-4b67-b4b2-4c0789fb691f'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:13:39.941786 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-b62dcd54-0c49-4ad8-a436-7865bd61fd84 admin admin] 10.222.0.68 "PUT /v2.0/routers/d0653611-f9db-4b67-b4b2-4c0789fb691f/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.9614546
Jun 01 10:13:39.942052 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37570) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:39.946302 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb417e3e-73a9-490a-ba81-1ca8a82a3d1d None None] Routers {'d0653611-f9db-4b67-b4b2-4c0789fb691f'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:13:39.946981 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-eb417e3e-73a9-490a-ba81-1ca8a82a3d1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72ae8fd0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:13:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d0653611-f9db-4b67-b4b2-4c0789fb691f'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:40.025848 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd341da-483a-442f-8421-3b8d86f63095 req-6d233d45-f00b-44b0-ae21-ae9de4fa2346 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:40.027252 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddd341da-483a-442f-8421-3b8d86f63095 req-6d233d45-f00b-44b0-ae21-ae9de4fa2346 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/networks?id=83aff072-8820-4a36-b8f3-036a7011aace HTTP/1.1" status: 200  len: 809 time: 0.1440859
Jun 01 10:13:40.043468 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddd341da-483a-442f-8421-3b8d86f63095 req-33ee4bb9-b794-4d96-a938-a6afaa12ef30 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/quotas/cfa9132b1ba044548228b96f6c2755eb HTTP/1.1" status: 200  len: 375 time: 0.0096376
Jun 01 10:13:40.121690 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] Notify callbacks [] for router, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:40.129649 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-eb417e3e-73a9-490a-ba81-1ca8a82a3d1d None None] Set router d0653611-f9db-4b67-b4b2-4c0789fb691f gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:13:40.135854 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddd341da-483a-442f-8421-3b8d86f63095 req-8a7bc0f1-f893-4399-a365-aa3c0bc12d97 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0857232
Jun 01 10:13:40.424681 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:40.425388 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddd341da-483a-442f-8421-3b8d86f63095 req-0b40bd79-1522-47f7-bd98-5eed0f278f70 service neutron] 10.222.0.68 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2773883
Jun 01 10:13:40.450137 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-eb417e3e-73a9-490a-ba81-1ca8a82a3d1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72ae8fd0>, [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16'}], 'enable_snat': True}, 'gw_port_id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:13:38Z', 'revision_number': 5, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port': {'id': 'a0439258-ab2e-431a-bcd9-3f137ae4d80a', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:ae:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:03Z', 'updated_at': '2021-06-01T10:06:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:40.453927 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb417e3e-73a9-490a-ba81-1ca8a82a3d1d None None] Checking router: d0653611-f9db-4b67-b4b2-4c0789fb691f for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:13:40.462147 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb417e3e-73a9-490a-ba81-1ca8a82a3d1d None None] Routers {'d0653611-f9db-4b67-b4b2-4c0789fb691f'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:13:40.462778 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-eb417e3e-73a9-490a-ba81-1ca8a82a3d1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72ae8fd0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:13:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d0653611-f9db-4b67-b4b2-4c0789fb691f'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:40.469812 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:13:40.526824 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-4fe454d0-3fa4-40f9-b087-b67f67792487 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:40.569354 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddd341da-483a-442f-8421-3b8d86f63095 req-1f709c20-a277-4da2-9aac-b314135359d9 service neutron] 10.222.0.68 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1347859
Jun 01 10:13:40.571893 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] Deleting port a0439258-ab2e-431a-bcd9-3f137ae4d80a {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:13:40.573116 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:40.640315 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-eb417e3e-73a9-490a-ba81-1ca8a82a3d1d None None] Set router d0653611-f9db-4b67-b4b2-4c0789fb691f gateway port host: None {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:13:40.707032 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] For port a0439258-ab2e-431a-bcd9-3f137ae4d80a, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=a0439258-ab2e-431a-bcd9-3f137ae4d80a,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:13:40.707387 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:40.751941 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-eb417e3e-73a9-490a-ba81-1ca8a82a3d1d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72ae8fd0>, [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:13:40Z', 'revision_number': 6, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port_host': None}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:40.755937 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb417e3e-73a9-490a-ba81-1ca8a82a3d1d None None] The sync data for ids ['d0653611-f9db-4b67-b4b2-4c0789fb691f'] in dv-cinder-787262-4-iscsi is: [{'id': 'd0653611-f9db-4b67-b4b2-4c0789fb691f', 'name': 'tempest-AttachVolumeTestJSON-329751285-router', 'tenant_id': 'd13dc1de700d428a8982ca87f11948d0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:01Z', 'updated_at': '2021-06-01T10:13:40Z', 'revision_number': 6, 'project_id': 'd13dc1de700d428a8982ca87f11948d0', 'gw_port_host': None}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:13:40.858543 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] Calling delete_port for a0439258-ab2e-431a-bcd9-3f137ae4d80a owned by network:router_gateway {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:13:41.043748 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:41.048633 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:41.098972 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] Pushing event deleted for resources: {'Port': ['ID=a0439258-ab2e-431a-bcd9-3f137ae4d80a,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:41.131790 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:41.201517 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-403627'] for router_gateway, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:41.299298 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1850561-d7c4-467a-a024-d9b944a25635 req-e5999974-e5a8-4ef0-812b-0a694398c120 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 210 time: 0.0455229
Jun 01 10:13:41.389944 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-405542', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-15816'] for router, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:41.392273 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:41.553163 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-406042'] for router, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:41.553750 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d0653611-f9db-4b67-b4b2-4c0789fb691f {{(pid=92565) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 10:13:41.571707 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] Notify callbacks [] for router, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:41.572922 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] 10.222.0.68 "DELETE /v2.0/routers/d0653611-f9db-4b67-b4b2-4c0789fb691f HTTP/1.1" status: 204  len: 168 time: 1.6299927
Jun 01 10:13:41.575493 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37592) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:41.643527 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_v2 [None req-795f70d5-d8cc-4ee4-a9d9-7a1c646bb191 admin admin] Deleting subnet 2a00a573-a4bb-4d2d-a3e6-7aef03966618 {{(pid=92565) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 10:13:41.647203 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-795f70d5-d8cc-4ee4-a9d9-7a1c646bb191 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:41.682532 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:13:41.701944 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-795f70d5-d8cc-4ee4-a9d9-7a1c646bb191 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2998467'] for subnet, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:41.724697 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:13:41.725037 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 7bfeaa6d-b8ad-4555-9d26-13d5f9ec6d71 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:13:41.725636 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device a0439258-ab2e-431a-bcd9-3f137ae4d80a no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:13:41.763519 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: a0439258-ab2e-431a-bcd9-3f137ae4d80a {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:13:41.763868 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device a0439258-ab2e-431a-bcd9-3f137ae4d80a not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:13:41.857449 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-795f70d5-d8cc-4ee4-a9d9-7a1c646bb191 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7791835'] for subnet, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:42.198917 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-795f70d5-d8cc-4ee4-a9d9-7a1c646bb191 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7793006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2233195', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3139387'] for subnet, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:42.203945 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8f51cd0d-21ab-4f53-a10d-235623b6fb71 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:42.239072 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-795f70d5-d8cc-4ee4-a9d9-7a1c646bb191 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2a00a573-a4bb-4d2d-a3e6-7aef03966618,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:42.241008 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-795f70d5-d8cc-4ee4-a9d9-7a1c646bb191 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:42.243543 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-795f70d5-d8cc-4ee4-a9d9-7a1c646bb191 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:42.247200 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ea713c3-ed63-4080-9b8c-e977a830a683 None None] Network 3d9ff4d3-b145-4108-a593-976a9cfb63dc requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:13:42.248228 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-795f70d5-d8cc-4ee4-a9d9-7a1c646bb191 admin admin] 10.222.0.68 "DELETE /v2.0/subnets/2a00a573-a4bb-4d2d-a3e6-7aef03966618 HTTP/1.1" status: 204  len: 168 time: 0.6718001
Jun 01 10:13:42.251037 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37600) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:42.460372 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7813807'] for network, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:42.460575 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-64d4699b-ef32-4185-9e1d-972ea0ab20d8 req-cbcf6112-43d7-482f-8068-b0eeafc68e62 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 210 time: 0.0449193
Jun 01 10:13:42.534549 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49d721ad-3fc8-4b5d-a8f8-f80bc744fbae None None] DHCP port deletion for 3d9ff4d3-b145-4108-a593-976a9cfb63dc request from dv-cinder-787262-4-iscsi {{(pid=92567) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 10:13:42.546058 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Deleting port 3aa4d326-15d8-4949-83b8-93a38e3c8666 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:13:42.546527 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:42.641360 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-49d721ad-3fc8-4b5d-a8f8-f80bc744fbae None None] Deleting port 3aa4d326-15d8-4949-83b8-93a38e3c8666 {{(pid=92567) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:13:42.641833 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-49d721ad-3fc8-4b5d-a8f8-f80bc744fbae None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:42.648893 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] For port 3aa4d326-15d8-4949-83b8-93a38e3c8666, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=3aa4d326-15d8-4949-83b8-93a38e3c8666,segment=NetworkSegment(2f350557-5423-4a12-a64b-0bf55f2578e6),segment_id=2f350557-5423-4a12-a64b-0bf55f2578e6)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:13:42.649414 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:42.744020 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-49d721ad-3fc8-4b5d-a8f8-f80bc744fbae None None] For port 3aa4d326-15d8-4949-83b8-93a38e3c8666, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=3aa4d326-15d8-4949-83b8-93a38e3c8666,segment=NetworkSegment(2f350557-5423-4a12-a64b-0bf55f2578e6),segment_id=2f350557-5423-4a12-a64b-0bf55f2578e6)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:13:42.744595 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-49d721ad-3fc8-4b5d-a8f8-f80bc744fbae None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:42.777500 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Calling delete_port for 3aa4d326-15d8-4949-83b8-93a38e3c8666 owned by network:dhcp {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:13:42.867018 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-49d721ad-3fc8-4b5d-a8f8-f80bc744fbae None None] Calling delete_port for 3aa4d326-15d8-4949-83b8-93a38e3c8666 owned by network:dhcp {{(pid=92567) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:13:42.907253 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:42.912251 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:42.955465 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Pushing event deleted for resources: {'Port': ['ID=3aa4d326-15d8-4949-83b8-93a38e3c8666,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:42.958651 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:42.959690 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] No DVR routers for this DVR port 3aa4d326-15d8-4949-83b8-93a38e3c8666 on host dv-cinder-787262-4-iscsi {{(pid=92565) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:13:42.984152 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-c4c76a1e-ebbb-4c5e-b721-a9e39ba7fb0f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:43.015301 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-49d721ad-3fc8-4b5d-a8f8-f80bc744fbae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820'] for port, after_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:43.018789 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-75d1443d-095c-4fc2-9900-951b4b0462a5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:43.065070 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49d721ad-3fc8-4b5d-a8f8-f80bc744fbae None None] Pushing event deleted for resources: {'Port': ['ID=3aa4d326-15d8-4949-83b8-93a38e3c8666,revision_number=None']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:43.067964 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49d721ad-3fc8-4b5d-a8f8-f80bc744fbae None None] No DVR routers for this DVR port 3aa4d326-15d8-4949-83b8-93a38e3c8666 on host dv-cinder-787262-4-iscsi {{(pid=92567) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:13:43.068287 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-49d721ad-3fc8-4b5d-a8f8-f80bc744fbae None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:43.088467 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7795028', 'neutron.services.segments.db._delete_segments_for_network-8726958294492'] for network, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:43.101621 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7efe7101d820>,) {'filters': {'network_id': ['3d9ff4d3-b145-4108-a593-976a9cfb63dc']}} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:43.113952 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7efe7101d820>, '2f350557-5423-4a12-a64b-0bf55f2578e6') {'for_net_delete': True} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:43.114279 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7efe7101d820>, '2f350557-5423-4a12-a64b-0bf55f2578e6') {} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:43.125959 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726958303133', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2998472'] for segment, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:43.142329 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:43.148231 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Releasing vlan 860 on physical network physnet1 to pool {{(pid=92565) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 10:13:43.148715 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2295757'] for segment, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]: Traceback (most recent call last):
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:     timer()
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:     cb(*args, **kw)
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:     return func(*args, **kwargs)
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:     self._notify()
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:     self.callback(batched_events)
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:     event.method(event)
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:     return f(self, *a, **k)
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._get(url).json()
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self.request(url, 'GET', **kwargs)
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 10:13:43.161669 dv-cinder-787262-4-iscsi neutron-server[92565]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 10:13:43.290347 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:43.342688 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7795037', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-403638'] for network, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:43.346540 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-752cee08-a5b4-4f45-9741-40fe5e88159b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:43.362489 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:43.371576 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Pushing event deleted for resources: {'Network': ['ID=3d9ff4d3-b145-4108-a593-976a9cfb63dc,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:43.374785 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:43.497238 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] 10.222.0.68 "DELETE /v2.0/networks/3d9ff4d3-b145-4108-a593-976a9cfb63dc HTTP/1.1" status: 204  len: 168 time: 1.2452300
Jun 01 10:13:43.646945 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6924f052-edf0-4a64-a53d-4dd7b97c56bd req-ed129b66-5ab1-4807-882e-03b58c16c23a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 210 time: 0.0751350
Jun 01 10:13:43.674614 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 3aa4d326-15d8-4949-83b8-93a38e3c8666 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:13:43.708240 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: 3aa4d326-15d8-4949-83b8-93a38e3c8666 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:13:43.708591 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 3aa4d326-15d8-4949-83b8-93a38e3c8666 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:13:43.774652 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd341da-483a-442f-8421-3b8d86f63095 req-8c8955f4-2622-41f7-adfe-fb5c7fdd6f6d tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:43.776306 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddd341da-483a-442f-8421-3b8d86f63095 req-8c8955f4-2622-41f7-adfe-fb5c7fdd6f6d tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.30 "GET /v2.0/networks?id=83aff072-8820-4a36-b8f3-036a7011aace HTTP/1.1" status: 200  len: 809 time: 0.1659589
Jun 01 10:13:43.827977 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddd341da-483a-442f-8421-3b8d86f63095 req-bf6ab784-569c-473a-88af-8a428ec0c0e4 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=cfa9132b1ba044548228b96f6c2755eb HTTP/1.1" status: 200  len: 379 time: 0.0406809
Jun 01 10:13:43.836633 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-ddd341da-483a-442f-8421-3b8d86f63095 req-78865941-7433-4af7-92a1-e7e2c4f18101 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Request body: {'port': {'device_id': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'admin_state_up': True, 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'security_groups': ['53e3d69f-76f1-4e9a-808e-b6a7c88db3f4']}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:13:43.900106 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37614) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:43.952676 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-968e5c62-d4f5-4658-9023-21edc4bec9ad admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=d13dc1de700d428a8982ca87f11948d0&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0491323
Jun 01 10:13:43.952906 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37620) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:43.987114 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-ddd341da-483a-442f-8421-3b8d86f63095 req-78865941-7433-4af7-92a1-e7e2c4f18101 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:43.998365 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-ddd341da-483a-442f-8421-3b8d86f63095 req-78865941-7433-4af7-92a1-e7e2c4f18101 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:44.034208 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-418c006a-6d83-464c-bcaf-34fdcc12a72f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:44.062748 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-418c006a-6d83-464c-bcaf-34fdcc12a72f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:44.066728 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:44.096560 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ddd341da-483a-442f-8421-3b8d86f63095 req-78865941-7433-4af7-92a1-e7e2c4f18101 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Made reservation on behalf of cfa9132b1ba044548228b96f6c2755eb for: {'port': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:13:44.098685 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-ddd341da-483a-442f-8421-3b8d86f63095 req-78865941-7433-4af7-92a1-e7e2c4f18101 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:44.192179 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-418c006a-6d83-464c-bcaf-34fdcc12a72f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:44.199580 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b8477aa3-592d-4b86-a03f-d254baa75bb7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:44.220141 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-418c006a-6d83-464c-bcaf-34fdcc12a72f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=83cd1cf9-b375-48d4-98e6-e6a6677acde3,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:44.227524 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-418c006a-6d83-464c-bcaf-34fdcc12a72f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:44.230658 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-418c006a-6d83-464c-bcaf-34fdcc12a72f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:44.232661 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-418c006a-6d83-464c-bcaf-34fdcc12a72f admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/83cd1cf9-b375-48d4-98e6-e6a6677acde3 HTTP/1.1" status: 204  len: 168 time: 0.2787955
Jun 01 10:13:44.280767 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [req-ddd341da-483a-442f-8421-3b8d86f63095 req-78865941-7433-4af7-92a1-e7e2c4f18101 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Allocated IP 172.20.0.9 (83aff072-8820-4a36-b8f3-036a7011aace/38dbf18a-9bde-4c4a-b149-d02ad12671d3/7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:13:44.422811 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c12973d-246e-4301-942d-13e53cc2b83b req-fb956260-8d61-40ba-8e4a-d2e313f1c1b2 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:44.424207 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1c12973d-246e-4301-942d-13e53cc2b83b req-fb956260-8d61-40ba-8e4a-d2e313f1c1b2 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 946 time: 0.0846519
Jun 01 10:13:44.537107 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1c12973d-246e-4301-942d-13e53cc2b83b req-12b5af0c-7cfd-4f56-8a42-b99f81bedec6 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1070557
Jun 01 10:13:44.560832 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37632) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:44.592485 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-ddd341da-483a-442f-8421-3b8d86f63095 req-78865941-7433-4af7-92a1-e7e2c4f18101 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:44.609188 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-ddd341da-483a-442f-8421-3b8d86f63095 req-78865941-7433-4af7-92a1-e7e2c4f18101 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Transition to ACTIVE for port object 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea will not be triggered until provisioned by entity DHCP. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:13:44.707934 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-ddd341da-483a-442f-8421-3b8d86f63095 req-78865941-7433-4af7-92a1-e7e2c4f18101 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:44.722991 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f96c3ef1-b30a-4154-8175-d7d6296e9867 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:44.830039 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ddd341da-483a-442f-8421-3b8d86f63095 req-78865941-7433-4af7-92a1-e7e2c4f18101 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Network 83aff072-8820-4a36-b8f3-036a7011aace is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:13:44.844059 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [req-ddd341da-483a-442f-8421-3b8d86f63095 req-78865941-7433-4af7-92a1-e7e2c4f18101 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:13:44.858142 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-ddd341da-483a-442f-8421-3b8d86f63095 req-78865941-7433-4af7-92a1-e7e2c4f18101 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:13:44.879443 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7aeb7dd-2305-4aff-89f3-6a9722a33ba9 tempest-TestMinimumBasicScenario-2100894056 tempest-TestMinimumBasicScenario-2100894056-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:44.881226 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-a7aeb7dd-2305-4aff-89f3-6a9722a33ba9 tempest-TestMinimumBasicScenario-2100894056 tempest-TestMinimumBasicScenario-2100894056-project-admin] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 1094 time: 0.3191214
Jun 01 10:13:44.883930 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37648) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:44.893342 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Request body: {'floatingip': {'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'port_id': '14a54ac6-61b8-43e2-b571-8a9993ebd80c', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'fixed_ip_address': '172.20.0.11'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:13:44.900645 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:44.905877 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Usage tracker for resource:floatingip and tenant:42ccd1aa89a94252b32a254cead654ef is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:44.909093 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:44.915236 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:44.940319 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd341da-483a-442f-8421-3b8d86f63095 req-78865941-7433-4af7-92a1-e7e2c4f18101 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:44.940855 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-ddd341da-483a-442f-8421-3b8d86f63095 req-78865941-7433-4af7-92a1-e7e2c4f18101 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:44.954420 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78865941-7433-4af7-92a1-e7e2c4f18101 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event updated for resources: {'Port': ['ID=7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:44.960788 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-78865941-7433-4af7-92a1-e7e2c4f18101 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:44.989258 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7b6236c-d16d-4f10-b016-661517bb1e96 req-9ee10bea-4dde-417b-a14e-baa98df88e86 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:44.990358 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-f7b6236c-d16d-4f10-b016-661517bb1e96 req-9ee10bea-4dde-417b-a14e-baa98df88e86 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Synchronizing usage tracker for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:13:45.014517 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for floatingip, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:45.086815 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddd341da-483a-442f-8421-3b8d86f63095 req-78865941-7433-4af7-92a1-e7e2c4f18101 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.2538610
Jun 01 10:13:45.099311 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Request body: {'port': {'device_id': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:13:45.143737 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-f7b6236c-d16d-4f10-b016-661517bb1e96 req-9ee10bea-4dde-417b-a14e-baa98df88e86 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Unset dirty status for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:13:45.144796 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f7b6236c-d16d-4f10-b016-661517bb1e96 req-9ee10bea-4dde-417b-a14e-baa98df88e86 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 931 time: 0.3720615
Jun 01 10:13:45.177411 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:45.210348 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-06e9c380-7ade-4650-aa71-64776c3dab76 None None] Provisioning for port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:13:45.216644 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-06e9c380-7ade-4650-aa71-64776c3dab76 None None] Provisioning complete for port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:13:45.217130 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-06e9c380-7ade-4650-aa71-64776c3dab76 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:45.256035 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f7b6236c-d16d-4f10-b016-661517bb1e96 req-743828a6-435a-4abe-91fd-7c84bb236cbe tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1033347
Jun 01 10:13:45.268690 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:45.334404 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-06e9c380-7ade-4650-aa71-64776c3dab76 None None] Port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:13:45.339072 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Allocated IP 172.27.2.241 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/b18e200f-e82e-49f0-92cd-b2dbcc493bb8) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:13:45.505963 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:45.579472 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37662) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:45.651252 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:45.655997 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b33a68c1-87c0-4cee-94bf-4fb144410e60 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:45.707862 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-2031253431-network', 'tenant_id': 'a4d3b988c4ec441192083d71f5216bf4'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:13:45.730011 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:45.736435 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:13:45.737476 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Usage tracker for resource:network and tenant:a4d3b988c4ec441192083d71f5216bf4 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:45.742434 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:13:45.746075 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:45.751420 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:13:45.761510 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea {{(pid=92566) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:13:45.768910 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:45.776526 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:45.781497 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Pushing event updated for resources: {'Port': ['ID=b18e200f-e82e-49f0-92cd-b2dbcc493bb8,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:45.783610 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Transition to ACTIVE for port object 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea will not be triggered until provisioned by entity L2. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:13:45.788068 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:45.790088 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:45.890123 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:45.894334 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-946ca452-9694-4052-af8f-242e8ab02a1f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:45.996697 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Made reservation on behalf of a4d3b988c4ec441192083d71f5216bf4 for: {'network': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:13:45.998962 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:46.017367 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:46.045676 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:46.053281 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Usage tracker for resource:security_group_rule and tenant:a4d3b988c4ec441192083d71f5216bf4 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:46.059333 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58040a77-530d-404a-9257-4a049baa876c service neutron] Pushing event updated for resources: {'Port': ['ID=7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:46.062812 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:46.070251 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-58040a77-530d-404a-9257-4a049baa876c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:46.131524 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:46.148879 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Attempting to bind port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:13:46.149152 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Attempting to bind port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:13:46.149474 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Attempting to bind port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea on network 83aff072-8820-4a36-b8f3-036a7011aace {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:13:46.154929 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea on network 83aff072-8820-4a36-b8f3-036a7011aace not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:13:46.155342 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Attempting to bind port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea on network 83aff072-8820-4a36-b8f3-036a7011aace {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:13:46.160770 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 13, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:13:46.161104 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Checking segment: {'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:13:46.161485 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Bound using segment: {'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:13:46.161907 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Bound port: 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'}}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:13:46.162456 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:46.252720 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] For port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea, host hv-cinder-78726, cleared binding levels {{(pid=92566) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:13:46.255576 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] For port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92566) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:13:46.336722 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:46.339316 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:46.342643 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-20dd30dc-7eab-42b9-a918-7d4fbad85893 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:46.374971 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:46.452155 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:46.452781 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:46.454235 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddd341da-483a-442f-8421-3b8d86f63095 req-58040a77-530d-404a-9257-4a049baa876c service neutron] 10.222.0.30 "PUT /v2.0/ports/7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea HTTP/1.1" status: 200  len: 1093 time: 1.3590977
Jun 01 10:13:46.455688 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'tag': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:13:46.457968 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0f863909-e895-481c-b376-9d0ebd5dbb30" -d '{"events": [{"name": "network-changed", "server_uuid": "00b98054-6f11-49b6-b07f-3178e4e5472d", "tag": "7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:13:46.461888 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:46.467515 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f8beb0fc-257a-4075-a815-d2be12f664ab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:46.487452 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58040a77-530d-404a-9257-4a049baa876c service neutron] Pushing event updated for resources: {'Port': ['ID=7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea,revision_number=3']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:46.491324 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-58040a77-530d-404a-9257-4a049baa876c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:46.516231 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eea1eb6-8a9a-41ff-ba8a-5ce5f20c099e req-2ef2fd5d-e582-4a46-9900-bbc5afcad798 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:46.517929 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2eea1eb6-8a9a-41ff-ba8a-5ce5f20c099e req-2ef2fd5d-e582-4a46-9900-bbc5afcad798 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 943 time: 0.1373155
Jun 01 10:13:46.519602 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:13:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a686bc6a-923a-405d-a5f8-1162bc7d8fb3 x-openstack-request-id: req-a686bc6a-923a-405d-a5f8-1162bc7d8fb3 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:13:46.519925 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "00b98054-6f11-49b6-b07f-3178e4e5472d", "tag": "7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:13:46.520340 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-a686bc6a-923a-405d-a5f8-1162bc7d8fb3 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:13:46.520767 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'tag': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea', 'status': 'completed', 'code': 200}
Jun 01 10:13:46.555362 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 862}  {{(pid=92565) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:13:46.557117 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ef67abe7-bf06-4a15-a1b6-b2ac81b3af47,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:46.568563 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:46.585940 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:46.586424 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.segments_db [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Added segment 33e58552-68cf-40f7-8d11-298c93ea7e0a of type vlan for network 73b0d78b-a623-467a-9102-ac84e2c50ed6
Jun 01 10:13:46.598257 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:46.629685 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2eea1eb6-8a9a-41ff-ba8a-5ce5f20c099e req-9ff1c558-fb7e-4407-88c1-7aaf43baecce tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0984359
Jun 01 10:13:46.652968 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f863909-e895-481c-b376-9d0ebd5dbb30 req-5cdc6dea-d7ce-4c85-8cd8-20e8bbf76501 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:46.654558 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0f863909-e895-481c-b376-9d0ebd5dbb30 req-5cdc6dea-d7ce-4c85-8cd8-20e8bbf76501 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 1096 time: 0.1094670
Jun 01 10:13:46.666554 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:46.809216 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f863909-e895-481c-b376-9d0ebd5dbb30 req-a662b83a-636c-47b5-b447-dcf8ab2b676b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:46.810582 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0f863909-e895-481c-b376-9d0ebd5dbb30 req-a662b83a-636c-47b5-b447-dcf8ab2b676b service neutron] 10.222.0.30 "GET /v2.0/networks?tenant_id=cfa9132b1ba044548228b96f6c2755eb&shared=False HTTP/1.1" status: 200  len: 910 time: 0.1450105
Jun 01 10:13:46.828059 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:46.830321 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:46.830919 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:46.836471 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-880be6c9-a772-429c-8ef6-f3d6c9e4a469 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:46.951501 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f863909-e895-481c-b376-9d0ebd5dbb30 req-c745bd8c-9b2f-4d6c-9a32-3150eb4d781d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:46.953074 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0f863909-e895-481c-b376-9d0ebd5dbb30 req-c745bd8c-9b2f-4d6c-9a32-3150eb4d781d service neutron] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1361370
Jun 01 10:13:46.955213 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:46.959902 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Pushing event updated for resources: {'Network': ['ID=73b0d78b-a623-467a-9102-ac84e2c50ed6,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:46.962292 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:46.971564 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network 73b0d78b-a623-467a-9102-ac84e2c50ed6 details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:13:47.021802 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2295697'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:47.027686 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:47.069991 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd341da-483a-442f-8421-3b8d86f63095 req-b3c507be-f7d2-4be7-b7a2-5d88fb18f937 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:47.071345 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddd341da-483a-442f-8421-3b8d86f63095 req-b3c507be-f7d2-4be7-b7a2-5d88fb18f937 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 1096 time: 0.0759668
Jun 01 10:13:47.073718 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 1.4930673
Jun 01 10:13:47.076545 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37672) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:47.088089 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-e196daca-3672-4c47-a9cc-9b1a78575a38 admin admin] Request body: {'subnet': {'network_id': '73b0d78b-a623-467a-9102-ac84e2c50ed6', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-2031253431-subnet', 'tenant_id': 'a4d3b988c4ec441192083d71f5216bf4', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:13:47.089398 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-e196daca-3672-4c47-a9cc-9b1a78575a38 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:47.137373 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Pushing event updated for resources: {'Port': ['ID=b18e200f-e82e-49f0-92cd-b2dbcc493bb8,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:47.141549 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:47.150918 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:47.151088 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-e196daca-3672-4c47-a9cc-9b1a78575a38 admin admin] Usage tracker for resource:subnet and tenant:a4d3b988c4ec441192083d71f5216bf4 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:47.160012 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-e196daca-3672-4c47-a9cc-9b1a78575a38 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:47.163365 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddd341da-483a-442f-8421-3b8d86f63095 req-67ab5da7-bf98-42c4-acd9-7f80eb19dbf0 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea HTTP/1.1" status: 200  len: 217 time: 0.0752366
Jun 01 10:13:47.166933 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-e196daca-3672-4c47-a9cc-9b1a78575a38 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:47.230225 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd341da-483a-442f-8421-3b8d86f63095 req-db5965b2-98dc-4d23-b28c-f82656b2f27c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:47.231725 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddd341da-483a-442f-8421-3b8d86f63095 req-db5965b2-98dc-4d23-b28c-f82656b2f27c service neutron] 10.222.0.30 "GET /v2.0/subnets?id=38dbf18a-9bde-4c4a-b149-d02ad12671d3 HTTP/1.1" status: 200  len: 848 time: 0.0600219
Jun 01 10:13:47.278806 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e196daca-3672-4c47-a9cc-9b1a78575a38 admin admin] Made reservation on behalf of a4d3b988c4ec441192083d71f5216bf4 for: {'subnet': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:13:47.281150 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-e196daca-3672-4c47-a9cc-9b1a78575a38 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2837918'] for subnet, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:47.325296 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.l3_db [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Floating IP a04efc96-43e4-4391-b0d0-21d65c616a25 associated. External IP: 172.27.2.241, port: 14a54ac6-61b8-43e2-b571-8a9993ebd80c.
Jun 01 10:13:47.412750 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd341da-483a-442f-8421-3b8d86f63095 req-f6425b0a-9eae-471e-9cc0-76fc15c7b68b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:47.414221 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddd341da-483a-442f-8421-3b8d86f63095 req-f6425b0a-9eae-471e-9cc0-76fc15c7b68b service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=83aff072-8820-4a36-b8f3-036a7011aace&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1737742
Jun 01 10:13:47.715450 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddd341da-483a-442f-8421-3b8d86f63095 req-eaac2998-07b6-40b8-acea-cd614ffe1dae service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2927234
Jun 01 10:13:47.803171 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Router d44c71f4-9c5a-4af0-9ac9-0a309921c707 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:13:47.988424 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:13:47.995395 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddd341da-483a-442f-8421-3b8d86f63095 req-1f919792-1a20-4a8b-9d18-d2b99fe4c1cc service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2719178
Jun 01 10:13:47.999720 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75b8b8fe-0c4d-4377-8b47-1594e32a81ae None None] Sync routers for ids ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:13:48.011175 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75b8b8fe-0c4d-4377-8b47-1594e32a81ae None None] Routers {'d44c71f4-9c5a-4af0-9ac9-0a309921c707'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:13:48.012119 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-75b8b8fe-0c4d-4377-8b47-1594e32a81ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72612790>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:13:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:48.018920 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfe0b654-7967-4553-a5b2-13676755d08c req-dbf4ed87-7a3a-4705-8dee-b2d508da41b8 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:48.020390 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cfe0b654-7967-4553-a5b2-13676755d08c req-dbf4ed87-7a3a-4705-8dee-b2d508da41b8 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 943 time: 0.2714179
Jun 01 10:13:48.073378 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:48.082332 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cfe0b654-7967-4553-a5b2-13676755d08c req-b4f2033d-2e2a-43c6-b6b7-7678fd326696 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0557380
Jun 01 10:13:48.139138 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 3.2535226
Jun 01 10:13:48.140150 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'tag': '14a54ac6-61b8-43e2-b571-8a9993ebd80c'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:13:48.142708 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-76be0876-0b0b-423d-a8e0-5371dfcff20f" -d '{"events": [{"name": "network-changed", "server_uuid": "c52836ef-4dc8-4dd2-a679-e9d0cbeaa489", "tag": "14a54ac6-61b8-43e2-b571-8a9993ebd80c"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:13:48.144200 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37680) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:48.152133 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-6c151583-3068-4dff-8f5f-0ced3d54a048 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2000309515', 'description': 'tempest-secgroup-smoke-2000309515 description', 'project_id': '42ccd1aa89a94252b32a254cead654ef'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:13:48.161003 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6c151583-3068-4dff-8f5f-0ced3d54a048 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:48.168846 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6c151583-3068-4dff-8f5f-0ced3d54a048 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Usage tracker for resource:security_group and tenant:42ccd1aa89a94252b32a254cead654ef is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:48.171690 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-e196daca-3672-4c47-a9cc-9b1a78575a38 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2818108', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2837896'] for subnet, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:48.175640 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6c151583-3068-4dff-8f5f-0ced3d54a048 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:48.178462 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-4ad7ddb1-7e78-431c-9b1e-2990441f712e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:48.186122 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:13:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc813564-37b5-453e-bb38-960bb1c35a30 x-openstack-request-id: req-cc813564-37b5-453e-bb38-960bb1c35a30 {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:13:48.186452 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c52836ef-4dc8-4dd2-a679-e9d0cbeaa489", "tag": "14a54ac6-61b8-43e2-b571-8a9993ebd80c", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:13:48.186742 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-cc813564-37b5-453e-bb38-960bb1c35a30 {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:13:48.187218 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'tag': '14a54ac6-61b8-43e2-b571-8a9993ebd80c', 'status': 'completed', 'code': 200}
Jun 01 10:13:48.201667 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-75b8b8fe-0c4d-4377-8b47-1594e32a81ae None None] Set router d44c71f4-9c5a-4af0-9ac9-0a309921c707 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:13:48.214082 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6c151583-3068-4dff-8f5f-0ced3d54a048 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:48.306772 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e196daca-3672-4c47-a9cc-9b1a78575a38 admin admin] Pushing event updated for resources: {'Subnet': ['ID=78ae1330-2e45-4263-a18a-23bbeab2b3b2,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:48.314341 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-e196daca-3672-4c47-a9cc-9b1a78575a38 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:48.327653 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e196daca-3672-4c47-a9cc-9b1a78575a38 admin admin] Checking segment: {'id': '33e58552-68cf-40f7-8d11-298c93ea7e0a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': '73b0d78b-a623-467a-9102-ac84e2c50ed6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:13:48.327999 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e196daca-3672-4c47-a9cc-9b1a78575a38 admin admin] Network hostable DHCP agents. Network: 73b0d78b-a623-467a-9102-ac84e2c50ed6, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92566) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:13:48.343618 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6c151583-3068-4dff-8f5f-0ced3d54a048 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:48.375171 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76be0876-0b0b-423d-a8e0-5371dfcff20f req-eb2636a5-85af-4ab8-9a72-ffaf5c1caf6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:48.376681 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-76be0876-0b0b-423d-a8e0-5371dfcff20f req-eb2636a5-85af-4ab8-9a72-ffaf5c1caf6d service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=42ccd1aa89a94252b32a254cead654ef&device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 1099 time: 0.1556423
Jun 01 10:13:48.379517 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6c151583-3068-4dff-8f5f-0ced3d54a048 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:48.383911 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6c151583-3068-4dff-8f5f-0ced3d54a048 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Usage tracker for resource:security_group_rule and tenant:42ccd1aa89a94252b32a254cead654ef is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:48.405037 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6c151583-3068-4dff-8f5f-0ced3d54a048 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:48.415184 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6c151583-3068-4dff-8f5f-0ced3d54a048 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:48.471866 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e196daca-3672-4c47-a9cc-9b1a78575a38 admin admin] Network 73b0d78b-a623-467a-9102-ac84e2c50ed6 is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92566) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:13:48.551291 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-75b8b8fe-0c4d-4377-8b47-1594e32a81ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72612790>, [{'id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'name': 'tempest-TestMinimumBasicScenario-1893805309-router', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221'}], 'enable_snat': True}, 'gw_port_id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:20Z', 'updated_at': '2021-06-01T10:12:25Z', 'revision_number': 4, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'gw_port': {'id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:01:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:21Z', 'updated_at': '2021-06-01T10:12:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': 'a04efc96-43e4-4391-b0d0-21d65c616a25', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'floating_ip_address': '172.27.2.241', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'port_id': '14a54ac6-61b8-43e2-b571-8a9993ebd80c', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 519, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5', 'mac_address': 'fa:16:3e:a1:65:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:13:46Z', 'updated_at': '2021-06-01T10:13:46Z', 'revision_number': 0, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0c15f869-9e44-4931-a089-e90025a105a3', 'name': '', 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'mac_address': 'fa:16:3e:7a:de:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_interface', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:24Z', 'updated_at': '2021-06-01T10:12:34Z', 'revision_number': 5, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'subnets': [{'id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:48.551912 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76be0876-0b0b-423d-a8e0-5371dfcff20f req-924cd891-a61a-4cc4-9bb0-868d8014cc6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:48.553375 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-76be0876-0b0b-423d-a8e0-5371dfcff20f req-924cd891-a61a-4cc4-9bb0-868d8014cc6a service neutron] 10.222.0.30 "GET /v2.0/networks?id=d11181a0-389a-4fe3-b44f-805e01bb81e5 HTTP/1.1" status: 200  len: 916 time: 0.1669445
Jun 01 10:13:48.555851 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75b8b8fe-0c4d-4377-8b47-1594e32a81ae None None] Checking router: d44c71f4-9c5a-4af0-9ac9-0a309921c707 for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:13:48.564676 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75b8b8fe-0c4d-4377-8b47-1594e32a81ae None None] Routers {'d44c71f4-9c5a-4af0-9ac9-0a309921c707'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:13:48.565197 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-75b8b8fe-0c4d-4377-8b47-1594e32a81ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72612790>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:13:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:48.619719 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-e196daca-3672-4c47-a9cc-9b1a78575a38 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, 73b0d78b-a623-467a-9102-ac84e2c50ed6) {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:13:48.627973 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f1c01dd-f8e7-49b0-92ba-8b12aeb06961 None None] Network 73b0d78b-a623-467a-9102-ac84e2c50ed6 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:13:48.679249 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e196daca-3672-4c47-a9cc-9b1a78575a38 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:48.679857 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-e196daca-3672-4c47-a9cc-9b1a78575a38 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:48.689804 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6c151583-3068-4dff-8f5f-0ced3d54a048 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:48.710968 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-76be0876-0b0b-423d-a8e0-5371dfcff20f req-6f4d016b-d876-47e4-988a-fc014d77aa80 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=14a54ac6-61b8-43e2-b571-8a9993ebd80c HTTP/1.1" status: 200  len: 1000 time: 0.1471765
Jun 01 10:13:48.757562 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6c151583-3068-4dff-8f5f-0ced3d54a048 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:48.766030 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7b29c741-c161-433d-a0cf-f632e7a7eaaa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:48.781052 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-75b8b8fe-0c4d-4377-8b47-1594e32a81ae None None] Set router d44c71f4-9c5a-4af0-9ac9-0a309921c707 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:13:48.812553 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c151583-3068-4dff-8f5f-0ced3d54a048 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Pushing event updated for resources: {'SecurityGroup': ['ID=84f2a1e4-cc30-4691-8e14-0c27546b9656,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:48.820864 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6c151583-3068-4dff-8f5f-0ced3d54a048 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:48.820864 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-e196daca-3672-4c47-a9cc-9b1a78575a38 admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 862 time: 1.7421439
Jun 01 10:13:48.822007 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76be0876-0b0b-423d-a8e0-5371dfcff20f req-8b663336-e51c-4e21-986a-61652ab6b4de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:48.823446 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-76be0876-0b0b-423d-a8e0-5371dfcff20f req-8b663336-e51c-4e21-986a-61652ab6b4de service neutron] 10.222.0.30 "GET /v2.0/subnets?id=dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9 HTTP/1.1" status: 200  len: 854 time: 0.1046569
Jun 01 10:13:48.829935 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c911b099-9f6a-4cb2-bb89-893775dd22d7 None None] Network 73b0d78b-a623-467a-9102-ac84e2c50ed6 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:13:48.913385 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76be0876-0b0b-423d-a8e0-5371dfcff20f req-ce64012e-cf4f-41ce-851b-35aad64f4e98 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:48.915450 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-76be0876-0b0b-423d-a8e0-5371dfcff20f req-ce64012e-cf4f-41ce-851b-35aad64f4e98 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=d11181a0-389a-4fe3-b44f-805e01bb81e5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0844693
Jun 01 10:13:48.918201 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6c151583-3068-4dff-8f5f-0ced3d54a048 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:48.920168 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-6c151583-3068-4dff-8f5f-0ced3d54a048 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.7746859
Jun 01 10:13:48.923034 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37688) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:48.928421 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-fcc1ba69-ed6f-41c8-8361-f8907641458e tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Request body: {'security_group_rule': {'security_group_id': '84f2a1e4-cc30-4691-8e14-0c27546b9656', 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:13:48.940018 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-fcc1ba69-ed6f-41c8-8361-f8907641458e tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:48.946670 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-fcc1ba69-ed6f-41c8-8361-f8907641458e tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Usage tracker for resource:security_group_rule and tenant:42ccd1aa89a94252b32a254cead654ef is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:48.957372 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-fcc1ba69-ed6f-41c8-8361-f8907641458e tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:48.964099 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-fcc1ba69-ed6f-41c8-8361-f8907641458e tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:49.064074 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-76be0876-0b0b-423d-a8e0-5371dfcff20f req-81f41d7a-e266-4349-8424-cb0f8776ea1f service neutron] 10.222.0.30 "GET /v2.0/networks/d11181a0-389a-4fe3-b44f-805e01bb81e5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1407797
Jun 01 10:13:49.068613 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fcc1ba69-ed6f-41c8-8361-f8907641458e tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:49.146165 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fcc1ba69-ed6f-41c8-8361-f8907641458e tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:49.216839 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fcc1ba69-ed6f-41c8-8361-f8907641458e tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:49.218211 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-75b8b8fe-0c4d-4377-8b47-1594e32a81ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72612790>, [{'id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'name': 'tempest-TestMinimumBasicScenario-1893805309-router', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221'}], 'enable_snat': True}, 'gw_port_id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:20Z', 'updated_at': '2021-06-01T10:12:25Z', 'revision_number': 4, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'gw_port': {'id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:01:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:21Z', 'updated_at': '2021-06-01T10:12:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': 'a04efc96-43e4-4391-b0d0-21d65c616a25', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'floating_ip_address': '172.27.2.241', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'port_id': '14a54ac6-61b8-43e2-b571-8a9993ebd80c', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 519, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5', 'mac_address': 'fa:16:3e:a1:65:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:13:46Z', 'updated_at': '2021-06-01T10:13:46Z', 'revision_number': 0, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0c15f869-9e44-4931-a089-e90025a105a3', 'name': '', 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'mac_address': 'fa:16:3e:7a:de:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_interface', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:24Z', 'updated_at': '2021-06-01T10:12:34Z', 'revision_number': 5, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'subnets': [{'id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:49.223255 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75b8b8fe-0c4d-4377-8b47-1594e32a81ae None None] The sync data for ids ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'] in dv-cinder-787262-4-iscsi is: [{'id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'name': 'tempest-TestMinimumBasicScenario-1893805309-router', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221'}], 'enable_snat': True}, 'gw_port_id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:20Z', 'updated_at': '2021-06-01T10:12:25Z', 'revision_number': 4, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'gw_port': {'id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:01:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:21Z', 'updated_at': '2021-06-01T10:12:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': 'a04efc96-43e4-4391-b0d0-21d65c616a25', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'floating_ip_address': '172.27.2.241', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'port_id': '14a54ac6-61b8-43e2-b571-8a9993ebd80c', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 519, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5', 'mac_address': 'fa:16:3e:a1:65:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:13:46Z', 'updated_at': '2021-06-01T10:13:46Z', 'revision_number': 0, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0c15f869-9e44-4931-a089-e90025a105a3', 'name': '', 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'mac_address': 'fa:16:3e:7a:de:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_interface', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:24Z', 'updated_at': '2021-06-01T10:12:34Z', 'revision_number': 5, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'subnets': [{'id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:13:49.230054 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:49.257311 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-76be0876-0b0b-423d-a8e0-5371dfcff20f req-d824383a-875b-477f-a9df-7ef42726ff9a service neutron] 10.222.0.30 "GET /v2.0/networks/d11181a0-389a-4fe3-b44f-805e01bb81e5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1854360
Jun 01 10:13:49.257541 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcc1ba69-ed6f-41c8-8361-f8907641458e tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9e4692cd-f844-413b-a893-333d3e93c558,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:49.261054 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-fcc1ba69-ed6f-41c8-8361-f8907641458e tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:49.319802 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c415242-01ea-49dd-82a0-4b60bf6b9bad req-74478dbe-206c-4d96-aa43-788c712c982c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:49.319802 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5c415242-01ea-49dd-82a0-4b60bf6b9bad req-74478dbe-206c-4d96-aa43-788c712c982c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 943 time: 0.0970321
Jun 01 10:13:49.359900 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fcc1ba69-ed6f-41c8-8361-f8907641458e tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:49.366543 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-fcc1ba69-ed6f-41c8-8361-f8907641458e tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.4424014
Jun 01 10:13:49.366946 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5c415242-01ea-49dd-82a0-4b60bf6b9bad req-5aede2ea-045f-4f31-b53d-6fc321a2e1d0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0427902
Jun 01 10:13:49.367195 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37700) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:49.373810 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-742e27fe-e60c-413a-a4fb-5dd4649ba595 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Request body: {'security_group_rule': {'security_group_id': '84f2a1e4-cc30-4691-8e14-0c27546b9656', 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:13:49.385089 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-742e27fe-e60c-413a-a4fb-5dd4649ba595 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:49.389384 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-742e27fe-e60c-413a-a4fb-5dd4649ba595 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Usage tracker for resource:security_group_rule and tenant:42ccd1aa89a94252b32a254cead654ef is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:49.392909 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-742e27fe-e60c-413a-a4fb-5dd4649ba595 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:49.399380 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-742e27fe-e60c-413a-a4fb-5dd4649ba595 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:49.470865 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5694963-7d43-4f07-ac06-84f8e7e78bc7 None None] New status for floating IP a04efc96-43e4-4391-b0d0-21d65c616a25: ACTIVE {{(pid=92567) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:13:49.474623 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-742e27fe-e60c-413a-a4fb-5dd4649ba595 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:49.548856 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-742e27fe-e60c-413a-a4fb-5dd4649ba595 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:49.652477 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37710) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:49.660197 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1873494990-network', 'tenant_id': 'b8f1e8e49dba4046914272e25b1df5ad'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:13:49.666881 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:49.671381 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Usage tracker for resource:network and tenant:b8f1e8e49dba4046914272e25b1df5ad is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:49.674775 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:49.680647 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:50.250609 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-742e27fe-e60c-413a-a4fb-5dd4649ba595 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:50.256980 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-fcc1ba69-ed6f-41c8-8361-f8907641458e tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:50.267573 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Made reservation on behalf of b8f1e8e49dba4046914272e25b1df5ad for: {'network': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:13:50.274215 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:50.278051 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-742e27fe-e60c-413a-a4fb-5dd4649ba595 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=85fd6597-5b7d-4b9a-8bec-102a515dbe57,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:50.282279 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-742e27fe-e60c-413a-a4fb-5dd4649ba595 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:50.285471 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:50.300711 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:50.304628 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Usage tracker for resource:security_group_rule and tenant:b8f1e8e49dba4046914272e25b1df5ad is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:50.307468 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:50.313549 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:50.380361 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-742e27fe-e60c-413a-a4fb-5dd4649ba595 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:50.381608 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-742e27fe-e60c-413a-a4fb-5dd4649ba595 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 1.0131938
Jun 01 10:13:50.384924 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37714) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:50.389996 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-4e8810ce-48d2-4791-b4f1-63d44f899500 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Request body: {'security_group_rule': {'security_group_id': '84f2a1e4-cc30-4691-8e14-0c27546b9656', 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:13:50.395854 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-4e8810ce-48d2-4791-b4f1-63d44f899500 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:50.399931 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-4e8810ce-48d2-4791-b4f1-63d44f899500 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Usage tracker for resource:security_group_rule and tenant:42ccd1aa89a94252b32a254cead654ef is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:50.403959 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-4e8810ce-48d2-4791-b4f1-63d44f899500 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:50.411106 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-4e8810ce-48d2-4791-b4f1-63d44f899500 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:50.497078 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4e8810ce-48d2-4791-b4f1-63d44f899500 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:50.563453 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4e8810ce-48d2-4791-b4f1-63d44f899500 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:50.601369 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:50.637099 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1c2678-7629-42f5-bf14-5041bcce0516 req-b969fd02-ee0d-40a3-bfcb-42804eac6c2b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:50.638646 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-df1c2678-7629-42f5-bf14-5041bcce0516 req-b969fd02-ee0d-40a3-bfcb-42804eac6c2b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 943 time: 0.0951414
Jun 01 10:13:50.638850 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4e8810ce-48d2-4791-b4f1-63d44f899500 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:50.641017 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-742e27fe-e60c-413a-a4fb-5dd4649ba595 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:50.663425 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e8810ce-48d2-4791-b4f1-63d44f899500 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=65dcf299-3ef5-4032-8dee-f39430500889,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:50.665891 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-4e8810ce-48d2-4791-b4f1-63d44f899500 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:50.675174 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:50.682483 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-c88797ad-3ef3-4f96-b22d-fd03cbe69d6d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:50.706624 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-df1c2678-7629-42f5-bf14-5041bcce0516 req-a92ec819-c4c5-4852-9c9f-a4add38f6248 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0618160
Jun 01 10:13:50.725473 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 899}  {{(pid=92566) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:13:50.726290 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5db538f9-74a6-4fbd-92fe-d456e15d7dd2,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:50.729462 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:50.733617 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:50.733960 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.segments_db [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Added segment b1f3beb3-a7be-43fa-9f9b-903cd24cfcb7 of type vlan for network ceca3cf1-32f2-41d2-bcf7-6f1e28f7b8da
Jun 01 10:13:50.761857 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:50.774701 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4e8810ce-48d2-4791-b4f1-63d44f899500 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:50.776012 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-4e8810ce-48d2-4791-b4f1-63d44f899500 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.3901646
Jun 01 10:13:50.778871 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37720) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:50.786403 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-eea3205f-98ad-48c8-b940-f8e5b36edcc9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Request body: {'security_group_rule': {'security_group_id': '84f2a1e4-cc30-4691-8e14-0c27546b9656', 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:13:50.795321 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-eea3205f-98ad-48c8-b940-f8e5b36edcc9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:50.800379 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-eea3205f-98ad-48c8-b940-f8e5b36edcc9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Usage tracker for resource:security_group_rule and tenant:42ccd1aa89a94252b32a254cead654ef is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:50.803287 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-eea3205f-98ad-48c8-b940-f8e5b36edcc9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:50.809662 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-eea3205f-98ad-48c8-b940-f8e5b36edcc9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:50.865922 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:50.867308 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:50.867985 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:50.874747 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-8de4713e-2f51-4f08-8ca4-1c95c33e747a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:50.976350 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-eea3205f-98ad-48c8-b940-f8e5b36edcc9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:50.994963 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Pushing event updated for resources: {'Network': ['ID=ceca3cf1-32f2-41d2-bcf7-6f1e28f7b8da,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:50.997772 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:51.004884 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network ceca3cf1-32f2-41d2-bcf7-6f1e28f7b8da details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:13:51.048838 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-eea3205f-98ad-48c8-b940-f8e5b36edcc9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:51.091248 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 1.4374034
Jun 01 10:13:51.093793 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37724) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:51.099362 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-9dd0646e-d811-4c16-bb1b-e83edb7812a7 admin admin] Request body: {'subnet': {'network_id': 'ceca3cf1-32f2-41d2-bcf7-6f1e28f7b8da', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1873494990-subnet', 'tenant_id': 'b8f1e8e49dba4046914272e25b1df5ad', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:13:51.105699 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-9dd0646e-d811-4c16-bb1b-e83edb7812a7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:51.109430 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-9dd0646e-d811-4c16-bb1b-e83edb7812a7 admin admin] Usage tracker for resource:subnet and tenant:b8f1e8e49dba4046914272e25b1df5ad is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:51.112330 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-9dd0646e-d811-4c16-bb1b-e83edb7812a7 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:51.118296 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-9dd0646e-d811-4c16-bb1b-e83edb7812a7 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:51.164584 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-eea3205f-98ad-48c8-b940-f8e5b36edcc9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:51.172862 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:51.191245 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eea3205f-98ad-48c8-b940-f8e5b36edcc9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bf544d09-27f3-48c4-bbc1-f78798d24ca0,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:51.193807 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-eea3205f-98ad-48c8-b940-f8e5b36edcc9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:51.231345 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9dd0646e-d811-4c16-bb1b-e83edb7812a7 admin admin] Made reservation on behalf of b8f1e8e49dba4046914272e25b1df5ad for: {'subnet': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:13:51.233665 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-9dd0646e-d811-4c16-bb1b-e83edb7812a7 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2837918'] for subnet, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:51.299775 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-eea3205f-98ad-48c8-b940-f8e5b36edcc9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:51.300961 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-eea3205f-98ad-48c8-b940-f8e5b36edcc9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.5211477
Jun 01 10:13:51.303852 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37728) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:51.309733 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-6257ba14-e3af-4a56-a2f1-1f97db93c78d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Request body: {'security_group_rule': {'security_group_id': '84f2a1e4-cc30-4691-8e14-0c27546b9656', 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:13:51.315669 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-6257ba14-e3af-4a56-a2f1-1f97db93c78d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:51.320207 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-6257ba14-e3af-4a56-a2f1-1f97db93c78d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Usage tracker for resource:security_group_rule and tenant:42ccd1aa89a94252b32a254cead654ef is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:51.324545 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-6257ba14-e3af-4a56-a2f1-1f97db93c78d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:51.331416 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-6257ba14-e3af-4a56-a2f1-1f97db93c78d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:51.403319 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.securitygroups_db [None req-6257ba14-e3af-4a56-a2f1-1f97db93c78d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Project 42ccd1aa89a94252b32a254cead654ef added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 10:13:51.409181 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6257ba14-e3af-4a56-a2f1-1f97db93c78d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:51.475909 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6257ba14-e3af-4a56-a2f1-1f97db93c78d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:51.558838 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6257ba14-e3af-4a56-a2f1-1f97db93c78d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:51.561063 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b6f81d7e-616b-4c5a-962b-bfae6d819f5e tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:51.583083 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6257ba14-e3af-4a56-a2f1-1f97db93c78d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1e98235c-d4f1-4b6d-ab59-00f10858ea8b,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:51.585528 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-6257ba14-e3af-4a56-a2f1-1f97db93c78d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:51.638968 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-6257ba14-e3af-4a56-a2f1-1f97db93c78d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:51.640222 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-6257ba14-e3af-4a56-a2f1-1f97db93c78d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.3352971
Jun 01 10:13:51.643081 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37732) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:51.648189 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-89d91a58-7004-47bb-900b-460697b0f49f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Request body: {'security_group_rule': {'security_group_id': '84f2a1e4-cc30-4691-8e14-0c27546b9656', 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:13:51.654108 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-89d91a58-7004-47bb-900b-460697b0f49f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:13:51.657815 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-89d91a58-7004-47bb-900b-460697b0f49f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Usage tracker for resource:security_group_rule and tenant:42ccd1aa89a94252b32a254cead654ef is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:13:51.660795 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-89d91a58-7004-47bb-900b-460697b0f49f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:13:51.667286 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-89d91a58-7004-47bb-900b-460697b0f49f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:13:51.721682 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-9dd0646e-d811-4c16-bb1b-e83edb7812a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2818108', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2837896'] for subnet, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:51.726555 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-614377ae-119e-48f2-b5f0-9931e87e7d61 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:51.746163 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.securitygroups_db [None req-89d91a58-7004-47bb-900b-460697b0f49f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Project 42ccd1aa89a94252b32a254cead654ef added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 10:13:51.762240 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-89d91a58-7004-47bb-900b-460697b0f49f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:51.802426 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dd0646e-d811-4c16-bb1b-e83edb7812a7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=40c2b7c5-50a2-4858-bcdb-8d6c03087685,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:51.805110 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-9dd0646e-d811-4c16-bb1b-e83edb7812a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:51.808493 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9dd0646e-d811-4c16-bb1b-e83edb7812a7 admin admin] Checking segment: {'id': 'b1f3beb3-a7be-43fa-9f9b-903cd24cfcb7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'ceca3cf1-32f2-41d2-bcf7-6f1e28f7b8da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:13:51.809449 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9dd0646e-d811-4c16-bb1b-e83edb7812a7 admin admin] Network hostable DHCP agents. Network: ceca3cf1-32f2-41d2-bcf7-6f1e28f7b8da, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92566) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:13:51.836145 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-89d91a58-7004-47bb-900b-460697b0f49f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:51.884394 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9dd0646e-d811-4c16-bb1b-e83edb7812a7 admin admin] Network ceca3cf1-32f2-41d2-bcf7-6f1e28f7b8da is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92566) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:13:51.913177 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-89d91a58-7004-47bb-900b-460697b0f49f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:51.915502 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:51.917720 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0f7f730-39c7-46e7-bcaa-a981e04aee83 req-cf2e64d7-21b4-4844-ac89-3153ccfbc465 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:51.919362 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b0f7f730-39c7-46e7-bcaa-a981e04aee83 req-cf2e64d7-21b4-4844-ac89-3153ccfbc465 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 943 time: 0.0924699
Jun 01 10:13:51.938744 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89d91a58-7004-47bb-900b-460697b0f49f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=baa5b959-6498-4cf5-a4dd-5ad1a727a8e3,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:51.941207 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-89d91a58-7004-47bb-900b-460697b0f49f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:51.973967 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b0f7f730-39c7-46e7-bcaa-a981e04aee83 req-d167649d-fce6-45ed-ac6c-99f60cb81aab tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0488789
Jun 01 10:13:52.044607 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-9dd0646e-d811-4c16-bb1b-e83edb7812a7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, ceca3cf1-32f2-41d2-bcf7-6f1e28f7b8da) {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:13:52.052969 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4764c86-ae94-4787-bd86-1f99453f02a1 None None] Network ceca3cf1-32f2-41d2-bcf7-6f1e28f7b8da requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:13:52.054532 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9dd0646e-d811-4c16-bb1b-e83edb7812a7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:52.059757 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-9dd0646e-d811-4c16-bb1b-e83edb7812a7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:52.079120 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-89d91a58-7004-47bb-900b-460697b0f49f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:52.080336 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-89d91a58-7004-47bb-900b-460697b0f49f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.4363184
Jun 01 10:13:52.148844 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-9dd0646e-d811-4c16-bb1b-e83edb7812a7 admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 862 time: 1.0536959
Jun 01 10:13:52.211906 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-94b6e3af-48cd-496b-8415-5fff2dc9e285 req-bb5599d7-6b82-42fe-a5dc-218d05da9c0b tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Synchronizing usage tracker for tenant:42ccd1aa89a94252b32a254cead654ef on resource:security_group {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:13:52.252276 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96650b36-aa02-429d-9a84-232ce07b4fbb None None] Network ceca3cf1-32f2-41d2-bcf7-6f1e28f7b8da requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:13:52.285382 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37742) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:52.348242 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_v2 [None req-0e0f6781-c480-41d1-934c-71b8fda9aa81 admin admin] Deleting subnet 78ae1330-2e45-4263-a18a-23bbeab2b3b2 {{(pid=92566) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 10:13:52.351817 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-0e0f6781-c480-41d1-934c-71b8fda9aa81 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:52.386100 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-94b6e3af-48cd-496b-8415-5fff2dc9e285 req-bb5599d7-6b82-42fe-a5dc-218d05da9c0b tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Unset dirty status for tenant:42ccd1aa89a94252b32a254cead654ef on resource:security_group {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:13:52.387284 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-94b6e3af-48cd-496b-8415-5fff2dc9e285 req-bb5599d7-6b82-42fe-a5dc-218d05da9c0b tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2000309515&fields=id&tenant_id=42ccd1aa89a94252b32a254cead654ef HTTP/1.1" status: 200  len: 267 time: 0.2176998
Jun 01 10:13:52.447853 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-0e0f6781-c480-41d1-934c-71b8fda9aa81 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1800618'] for subnet, precommit_delete_associations {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:52.520217 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-0e0f6781-c480-41d1-934c-71b8fda9aa81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7791835'] for subnet, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:52.570446 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94b6e3af-48cd-496b-8415-5fff2dc9e285 req-4f7ca15a-96f7-4684-ab42-feb7e74ac384 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:52.571941 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-94b6e3af-48cd-496b-8415-5fff2dc9e285 req-4f7ca15a-96f7-4684-ab42-feb7e74ac384 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 946 time: 0.1788049
Jun 01 10:13:52.596615 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-94b6e3af-48cd-496b-8415-5fff2dc9e285 req-1ffcd77a-7b01-4442-9b2c-fef0149b1138 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Request body: {'port': {'security_groups': ['4c6403a1-41d1-46bb-a1d5-56a5a21fff27', '84f2a1e4-cc30-4691-8e14-0c27546b9656']}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:13:52.811185 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-94b6e3af-48cd-496b-8415-5fff2dc9e285 req-1ffcd77a-7b01-4442-9b2c-fef0149b1138 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:53.174962 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-0e0f6781-c480-41d1-934c-71b8fda9aa81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7793006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2818175', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2837889'] for subnet, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:53.194574 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:53.240832 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e0f6781-c480-41d1-934c-71b8fda9aa81 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=78ae1330-2e45-4263-a18a-23bbeab2b3b2,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:53.247799 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-0e0f6781-c480-41d1-934c-71b8fda9aa81 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:53.252063 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-0e0f6781-c480-41d1-934c-71b8fda9aa81 admin admin] Notify callbacks [] for subnet, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:53.276181 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-0e0f6781-c480-41d1-934c-71b8fda9aa81 admin admin] 10.222.0.68 "DELETE /v2.0/subnets/78ae1330-2e45-4263-a18a-23bbeab2b3b2 HTTP/1.1" status: 204  len: 168 time: 0.9896479
Jun 01 10:13:53.278879 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37748) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:53.306600 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-94b6e3af-48cd-496b-8415-5fff2dc9e285 req-1ffcd77a-7b01-4442-9b2c-fef0149b1138 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] For port 14a54ac6-61b8-43e2-b571-8a9993ebd80c, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=14a54ac6-61b8-43e2-b571-8a9993ebd80c,segment=NetworkSegment(4888209f-5226-40f1-b206-246370701bbd),segment_id=4888209f-5226-40f1-b206-246370701bbd)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:13:53.322528 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6154359a-bbd7-4fe5-8d01-e9858669e0cd req-3583b924-5135-4eab-94d0-3cc7d88de17f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:53.323998 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6154359a-bbd7-4fe5-8d01-e9858669e0cd req-3583b924-5135-4eab-94d0-3cc7d88de17f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 943 time: 0.2363451
Jun 01 10:13:53.361626 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-94b6e3af-48cd-496b-8415-5fff2dc9e285 req-1ffcd77a-7b01-4442-9b2c-fef0149b1138 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:53.383873 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6154359a-bbd7-4fe5-8d01-e9858669e0cd req-e1f9e993-b78c-4fc6-be63-c62539922eea tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0534136
Jun 01 10:13:53.389217 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-dab1f38f-c863-4dfb-bcc8-8df8c4b6738b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7813807'] for network, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:53.461948 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-94b6e3af-48cd-496b-8415-5fff2dc9e285 req-1ffcd77a-7b01-4442-9b2c-fef0149b1138 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:53.467838 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:53.474357 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['14a54ac6-61b8-43e2-b571-8a9993ebd80c'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:13:53.531515 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-dab1f38f-c863-4dfb-bcc8-8df8c4b6738b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7795028', 'neutron.services.segments.db._delete_segments_for_network-8726958294492'] for network, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:53.548708 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94b6e3af-48cd-496b-8415-5fff2dc9e285 req-1ffcd77a-7b01-4442-9b2c-fef0149b1138 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:53.548708 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-94b6e3af-48cd-496b-8415-5fff2dc9e285 req-1ffcd77a-7b01-4442-9b2c-fef0149b1138 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:53.548708 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-94b6e3af-48cd-496b-8415-5fff2dc9e285 req-1ffcd77a-7b01-4442-9b2c-fef0149b1138 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "PUT /v2.0/ports/14a54ac6-61b8-43e2-b571-8a9993ebd80c HTTP/1.1" status: 200  len: 982 time: 0.9611647
Jun 01 10:13:53.548708 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'tag': '14a54ac6-61b8-43e2-b571-8a9993ebd80c'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:13:53.548708 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8c13d974-ece5-4b81-af8a-358927a825f2" -d '{"events": [{"name": "network-changed", "server_uuid": "c52836ef-4dc8-4dd2-a679-e9d0cbeaa489", "tag": "14a54ac6-61b8-43e2-b571-8a9993ebd80c"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:13:53.564905 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-dab1f38f-c863-4dfb-bcc8-8df8c4b6738b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7efe711fba00>,) {'filters': {'network_id': ['73b0d78b-a623-467a-9102-ac84e2c50ed6']}} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:53.567850 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ffcd77a-7b01-4442-9b2c-fef0149b1138 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Pushing event updated for resources: {'Port': ['ID=14a54ac6-61b8-43e2-b571-8a9993ebd80c,revision_number=6']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:53.573007 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1ffcd77a-7b01-4442-9b2c-fef0149b1138 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:53.586260 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-dab1f38f-c863-4dfb-bcc8-8df8c4b6738b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7efe711fba00>, '33e58552-68cf-40f7-8d11-298c93ea7e0a') {'for_net_delete': True} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:53.587408 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-dab1f38f-c863-4dfb-bcc8-8df8c4b6738b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7efe711fba00>, '33e58552-68cf-40f7-8d11-298c93ea7e0a') {} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:53.611768 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-dab1f38f-c863-4dfb-bcc8-8df8c4b6738b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726958303133', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2998472'] for segment, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:53.612081 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:13:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1b4ddb08-dade-4d60-9feb-2a414cbec2f3 x-openstack-request-id: req-1b4ddb08-dade-4d60-9feb-2a414cbec2f3 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:13:53.612630 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c52836ef-4dc8-4dd2-a679-e9d0cbeaa489", "tag": "14a54ac6-61b8-43e2-b571-8a9993ebd80c", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:13:53.612875 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-1b4ddb08-dade-4d60-9feb-2a414cbec2f3 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:13:53.613799 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'tag': '14a54ac6-61b8-43e2-b571-8a9993ebd80c', 'status': 'completed', 'code': 200}
Jun 01 10:13:53.617624 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['14a54ac6-61b8-43e2-b571-8a9993ebd80c'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:13:53.642439 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-dab1f38f-c863-4dfb-bcc8-8df8c4b6738b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:53.649486 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dab1f38f-c863-4dfb-bcc8-8df8c4b6738b admin admin] Releasing vlan 862 on physical network physnet1 to pool {{(pid=92565) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 10:13:53.650214 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-dab1f38f-c863-4dfb-bcc8-8df8c4b6738b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2295757'] for segment, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]: Traceback (most recent call last):
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:     timer()
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:     cb(*args, **kw)
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:     return func(*args, **kwargs)
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:     self._notify()
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:     self.callback(batched_events)
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:     event.method(event)
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:     return f(self, *a, **k)
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._get(url).json()
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self.request(url, 'GET', **kwargs)
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 10:13:53.664960 dv-cinder-787262-4-iscsi neutron-server[92565]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 10:13:53.829374 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a09c5a7d-00d2-491b-8b61-5e3af47b929b req-4e60706d-5596-4d46-9720-041a99e4f552 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:53.830924 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a09c5a7d-00d2-491b-8b61-5e3af47b929b req-4e60706d-5596-4d46-9720-041a99e4f552 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 985 time: 0.1324074
Jun 01 10:13:53.833103 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c13d974-ece5-4b81-af8a-358927a825f2 req-255058c6-6b6b-40de-8205-48897b0b02a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:53.834522 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8c13d974-ece5-4b81-af8a-358927a825f2 req-255058c6-6b6b-40de-8205-48897b0b02a4 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=42ccd1aa89a94252b32a254cead654ef&device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 1138 time: 0.1951025
Jun 01 10:13:53.867737 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-dab1f38f-c863-4dfb-bcc8-8df8c4b6738b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7795037', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-403638'] for network, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:53.874239 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-dab1f38f-c863-4dfb-bcc8-8df8c4b6738b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:53.879561 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:53.902034 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dab1f38f-c863-4dfb-bcc8-8df8c4b6738b admin admin] Pushing event deleted for resources: {'Network': ['ID=73b0d78b-a623-467a-9102-ac84e2c50ed6,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:53.904591 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-dab1f38f-c863-4dfb-bcc8-8df8c4b6738b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:53.909208 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-dab1f38f-c863-4dfb-bcc8-8df8c4b6738b admin admin] 10.222.0.68 "DELETE /v2.0/networks/73b0d78b-a623-467a-9102-ac84e2c50ed6 HTTP/1.1" status: 204  len: 168 time: 0.6264887
Jun 01 10:13:53.909208 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37758) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:53.930979 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-9694b77c-eb9b-4dd7-9139-84cdeccff10c None None] Provisioning complete for port 14a54ac6-61b8-43e2-b571-8a9993ebd80c triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:13:53.931647 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-9694b77c-eb9b-4dd7-9139-84cdeccff10c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:53.964006 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a09c5a7d-00d2-491b-8b61-5e3af47b929b req-7fd2556b-a441-4ac2-9c3a-3d42bb98e4cb tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&id=84f2a1e4-cc30-4691-8e14-0c27546b9656&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.1271224
Jun 01 10:13:53.980108 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_v2 [None req-df5f93bb-5548-4be6-9441-902c5c97fce8 admin admin] Deleting subnet 40c2b7c5-50a2-4858-bcdb-8d6c03087685 {{(pid=92565) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 10:13:53.983725 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-df5f93bb-5548-4be6-9441-902c5c97fce8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:54.022147 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c13d974-ece5-4b81-af8a-358927a825f2 req-9f2119a9-e761-42da-ae77-ebce75da44b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:54.024160 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8c13d974-ece5-4b81-af8a-358927a825f2 req-9f2119a9-e761-42da-ae77-ebce75da44b3 service neutron] 10.222.0.30 "GET /v2.0/networks?id=d11181a0-389a-4fe3-b44f-805e01bb81e5 HTTP/1.1" status: 200  len: 916 time: 0.1712546
Jun 01 10:13:54.041657 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-df5f93bb-5548-4be6-9441-902c5c97fce8 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2998467'] for subnet, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:54.101393 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-df5f93bb-5548-4be6-9441-902c5c97fce8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7791835'] for subnet, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:54.134228 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8c13d974-ece5-4b81-af8a-358927a825f2 req-2e76debe-0f2a-4a06-8527-ce46b59de683 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=14a54ac6-61b8-43e2-b571-8a9993ebd80c HTTP/1.1" status: 200  len: 1002 time: 0.1023021
Jun 01 10:13:54.205753 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c13d974-ece5-4b81-af8a-358927a825f2 req-00601fbb-521c-4fcf-8705-e70059aadc76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:54.207333 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8c13d974-ece5-4b81-af8a-358927a825f2 req-00601fbb-521c-4fcf-8705-e70059aadc76 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9 HTTP/1.1" status: 200  len: 854 time: 0.0605419
Jun 01 10:13:54.295006 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c13d974-ece5-4b81-af8a-358927a825f2 req-91dcff10-3a04-4692-b287-bf694e24d27f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:54.296574 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8c13d974-ece5-4b81-af8a-358927a825f2 req-91dcff10-3a04-4692-b287-bf694e24d27f service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=d11181a0-389a-4fe3-b44f-805e01bb81e5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0816903
Jun 01 10:13:54.427604 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-df5f93bb-5548-4be6-9441-902c5c97fce8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7793006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2233195', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3139387'] for subnet, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:54.433435 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:54.437133 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8c13d974-ece5-4b81-af8a-358927a825f2 req-a44ccb3b-49cf-4134-85c7-a0f1fd5862f1 service neutron] 10.222.0.30 "GET /v2.0/networks/d11181a0-389a-4fe3-b44f-805e01bb81e5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1309075
Jun 01 10:13:54.470223 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-df5f93bb-5548-4be6-9441-902c5c97fce8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:54.477863 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df5f93bb-5548-4be6-9441-902c5c97fce8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=40c2b7c5-50a2-4858-bcdb-8d6c03087685,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:54.477863 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-df5f93bb-5548-4be6-9441-902c5c97fce8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:54.479925 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-df5f93bb-5548-4be6-9441-902c5c97fce8 admin admin] 10.222.0.68 "DELETE /v2.0/subnets/40c2b7c5-50a2-4858-bcdb-8d6c03087685 HTTP/1.1" status: 204  len: 168 time: 0.5697894
Jun 01 10:13:54.482365 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37766) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:54.637282 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8c13d974-ece5-4b81-af8a-358927a825f2 req-bdf8b14f-dd11-4c24-8855-30f40a5b9ff6 service neutron] 10.222.0.30 "GET /v2.0/networks/d11181a0-389a-4fe3-b44f-805e01bb81e5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1929188
Jun 01 10:13:54.652575 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac28cad5-d208-40f6-9d6c-7631c83aac48 req-3b3f8289-23b1-4db2-8a82-a8b3ae74327e tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:54.659424 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac28cad5-d208-40f6-9d6c-7631c83aac48 req-3b3f8289-23b1-4db2-8a82-a8b3ae74327e tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 943 time: 0.1407902
Jun 01 10:13:54.699018 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac28cad5-d208-40f6-9d6c-7631c83aac48 req-28bb7776-d267-4ce6-bc2b-a2a929681cf5 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0387211
Jun 01 10:13:54.700566 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b19b7e9c-c2e8-4757-9c5b-5d14eabf3b4a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7813807'] for network, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:54.824654 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b19b7e9c-c2e8-4757-9c5b-5d14eabf3b4a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7795028', 'neutron.services.segments.db._delete_segments_for_network-8726958294492'] for network, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:54.841068 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-b19b7e9c-c2e8-4757-9c5b-5d14eabf3b4a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7efe71d8e8e0>,) {'filters': {'network_id': ['ceca3cf1-32f2-41d2-bcf7-6f1e28f7b8da']}} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:54.852702 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-b19b7e9c-c2e8-4757-9c5b-5d14eabf3b4a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7efe71d8e8e0>, 'b1f3beb3-a7be-43fa-9f9b-903cd24cfcb7') {'for_net_delete': True} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:54.852995 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-b19b7e9c-c2e8-4757-9c5b-5d14eabf3b4a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7efe71d8e8e0>, 'b1f3beb3-a7be-43fa-9f9b-903cd24cfcb7') {} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:13:54.864666 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b19b7e9c-c2e8-4757-9c5b-5d14eabf3b4a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726958303133', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2998472'] for segment, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:54.880345 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b19b7e9c-c2e8-4757-9c5b-5d14eabf3b4a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:54.886749 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b19b7e9c-c2e8-4757-9c5b-5d14eabf3b4a admin admin] Releasing vlan 899 on physical network physnet1 to pool {{(pid=92565) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 10:13:54.887161 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b19b7e9c-c2e8-4757-9c5b-5d14eabf3b4a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2295757'] for segment, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]: Traceback (most recent call last):
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:     timer()
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:     cb(*args, **kw)
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:     return func(*args, **kwargs)
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:     self._notify()
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:     self.callback(batched_events)
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:     event.method(event)
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:     return f(self, *a, **k)
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._get(url).json()
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self.request(url, 'GET', **kwargs)
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 10:13:54.899786 dv-cinder-787262-4-iscsi neutron-server[92565]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 10:13:55.067385 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b19b7e9c-c2e8-4757-9c5b-5d14eabf3b4a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7795037', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-403638'] for network, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:55.070920 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:55.089065 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b19b7e9c-c2e8-4757-9c5b-5d14eabf3b4a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:55.098169 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b19b7e9c-c2e8-4757-9c5b-5d14eabf3b4a admin admin] Pushing event deleted for resources: {'Network': ['ID=ceca3cf1-32f2-41d2-bcf7-6f1e28f7b8da,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:55.101018 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-b19b7e9c-c2e8-4757-9c5b-5d14eabf3b4a admin admin] 10.222.0.68 "DELETE /v2.0/networks/ceca3cf1-32f2-41d2-bcf7-6f1e28f7b8da HTTP/1.1" status: 204  len: 168 time: 0.6173828
Jun 01 10:13:55.102139 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b19b7e9c-c2e8-4757-9c5b-5d14eabf3b4a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:55.370720 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:13:55.506097 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:13:55.519651 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'port_id': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea', 'mac_address': 'fa:16:3e:21:3e:0c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 857, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:13:55.522361 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37772) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:55.573930 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-8cd4f77e-59b2-4737-9d19-a839c209a7cf admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=a4d3b988c4ec441192083d71f5216bf4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0502691
Jun 01 10:13:55.575173 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:55.576411 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37776) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:55.592059 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:13:55.607797 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:13:55.635220 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-515f3753-d73f-4584-a186-ae06b414100b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:55.660150 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-515f3753-d73f-4584-a186-ae06b414100b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:55.672743 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:55.674543 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:55.747174 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:55.751166 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:55.758551 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-515f3753-d73f-4584-a186-ae06b414100b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:55.762975 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:55.774563 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-515f3753-d73f-4584-a186-ae06b414100b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef67abe7-bf06-4a15-a1b6-b2ac81b3af47,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:55.778785 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-515f3753-d73f-4584-a186-ae06b414100b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:55.782319 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-515f3753-d73f-4584-a186-ae06b414100b admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:55.785765 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-515f3753-d73f-4584-a186-ae06b414100b admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/ef67abe7-bf06-4a15-a1b6-b2ac81b3af47 HTTP/1.1" status: 204  len: 168 time: 0.2061558
Jun 01 10:13:55.900120 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f437d55-8f37-4e84-83a2-a25190435eac req-8b8d16da-4a7c-4612-b5e1-b4f7affda7bf tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:55.901532 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1f437d55-8f37-4e84-83a2-a25190435eac req-8b8d16da-4a7c-4612-b5e1-b4f7affda7bf tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 944 time: 0.0897744
Jun 01 10:13:55.923768 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:13:55.947146 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1f437d55-8f37-4e84-83a2-a25190435eac req-6ac39d96-8298-49c0-a5bc-2a6ac86ea950 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0399528
Jun 01 10:13:56.547058 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:56.584271 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37786) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:56.631519 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-abbe7916-e47d-465c-ba10-9a95fc0761ab admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=b8f1e8e49dba4046914272e25b1df5ad&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0460927
Jun 01 10:13:56.633917 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37790) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:13:56.689664 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-749b5096-1b80-4c57-82dd-3a6ef97448b1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:56.714604 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-749b5096-1b80-4c57-82dd-3a6ef97448b1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:56.839315 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-749b5096-1b80-4c57-82dd-3a6ef97448b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:56.844067 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-db176fce-6fbf-4055-bb62-e1f8e51386c5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:56.860153 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-749b5096-1b80-4c57-82dd-3a6ef97448b1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5db538f9-74a6-4fbd-92fe-d456e15d7dd2,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:56.862697 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-749b5096-1b80-4c57-82dd-3a6ef97448b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:56.864170 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-749b5096-1b80-4c57-82dd-3a6ef97448b1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:56.865252 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-749b5096-1b80-4c57-82dd-3a6ef97448b1 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/5db538f9-74a6-4fbd-92fe-d456e15d7dd2 HTTP/1.1" status: 204  len: 168 time: 0.2304282
Jun 01 10:13:57.213163 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3481505b-4310-4ccf-9374-07b49482553c req-8957a559-0dd1-461f-8278-9713d3654a42 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:57.214640 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3481505b-4310-4ccf-9374-07b49482553c req-8957a559-0dd1-461f-8278-9713d3654a42 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 944 time: 0.1645005
Jun 01 10:13:57.258859 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3481505b-4310-4ccf-9374-07b49482553c req-2d9de929-5091-4821-a31f-735639296f3b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385687
Jun 01 10:13:57.390061 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:13:57.518686 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:13:57.523935 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:13:57.524310 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:57.642365 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:57.668492 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:13:57.670664 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3088605f-9ac9-4b29-9795-a7e9339766d5" -d '{"events": [{"server_uuid": "00b98054-6f11-49b6-b07f-3178e4e5472d", "name": "network-vif-plugged", "status": "completed", "tag": "7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:13:57.683349 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:13:57.714763 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:13:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-faa9e991-5869-4b78-8648-6e5a1c170c4d x-openstack-request-id: req-faa9e991-5869-4b78-8648-6e5a1c170c4d {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:13:57.714763 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "00b98054-6f11-49b6-b07f-3178e4e5472d", "name": "network-vif-plugged", "status": "completed", "tag": "7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:13:57.714763 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-faa9e991-5869-4b78-8648-6e5a1c170c4d {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:13:57.714763 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea', 'code': 200}
Jun 01 10:13:57.769923 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:13:57.771874 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:13:57.841204 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:13:57.844235 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:13:58.179970 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d74107f-e094-4c4c-a515-b154189963a4 req-dcd146a6-1534-4c77-af2d-bdc81ed42007 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:58.181448 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0d74107f-e094-4c4c-a515-b154189963a4 req-dcd146a6-1534-4c77-af2d-bdc81ed42007 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 1098 time: 0.0727122
Jun 01 10:13:58.223798 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0d74107f-e094-4c4c-a515-b154189963a4 req-8fedabfd-34ca-4112-97a0-1cab4950a22f service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0350988
Jun 01 10:13:58.451195 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0384997b-4637-4bc1-b108-e5fb918c8a1c req-bdbaef13-132a-4a00-ab69-e2d2b6b90a77 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:58.452767 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0384997b-4637-4bc1-b108-e5fb918c8a1c req-bdbaef13-132a-4a00-ab69-e2d2b6b90a77 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 945 time: 0.0826068
Jun 01 10:13:58.500195 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0384997b-4637-4bc1-b108-e5fb918c8a1c req-3bed96ad-cc2d-4fd3-b68d-c0970aa07da5 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0417879
Jun 01 10:13:59.706802 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-201a1f32-a74e-45d2-9a3f-4286d951d52d req-7e08bb8f-95dd-4d1e-a4de-4759736bdaa3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:59.708414 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-201a1f32-a74e-45d2-9a3f-4286d951d52d req-7e08bb8f-95dd-4d1e-a4de-4759736bdaa3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 945 time: 0.0833538
Jun 01 10:13:59.760379 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-201a1f32-a74e-45d2-9a3f-4286d951d52d req-ff648f68-8969-43c6-b265-c8ac6f1e73af tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0455568
Jun 01 10:13:59.946550 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea01dd97-166b-4cb2-8762-a1a06676e4c0 req-f6cd9042-dfa8-4230-aaa3-53a5b8664014 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:13:59.948114 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ea01dd97-166b-4cb2-8762-a1a06676e4c0 req-f6cd9042-dfa8-4230-aaa3-53a5b8664014 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 945 time: 0.0837376
Jun 01 10:13:59.993191 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ea01dd97-166b-4cb2-8762-a1a06676e4c0 req-5543a77c-257f-4f84-ba1c-319413288721 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0395124
Jun 01 10:14:00.016454 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37872) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:00.086549 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f93a3444-4bd2-4158-898c-68f3cc680a33 tempest-TestVolumeBootPattern-1204700571 tempest-TestVolumeBootPattern-1204700571-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:00.091911 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-f93a3444-4bd2-4158-898c-68f3cc680a33 tempest-TestVolumeBootPattern-1204700571 tempest-TestVolumeBootPattern-1204700571-project-admin] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 1093 time: 0.0706229
Jun 01 10:14:00.092122 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37878) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:00.097481 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Request body: {'floatingip': {'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'port_id': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address': '172.20.0.9'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:14:00.104207 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:14:00.108411 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Usage tracker for resource:floatingip and tenant:cfa9132b1ba044548228b96f6c2755eb is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:14:00.111434 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:14:00.118639 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:14:00.209185 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for floatingip, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:00.241583 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-411103ad-7a2d-4bfa-b729-db86a92dc6f4 req-a9971225-d544-47f3-9b30-cdfdd69ff524 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:00.243482 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-411103ad-7a2d-4bfa-b729-db86a92dc6f4 req-a9971225-d544-47f3-9b30-cdfdd69ff524 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 946 time: 0.0876234
Jun 01 10:14:00.265480 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37884) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:00.297940 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-411103ad-7a2d-4bfa-b729-db86a92dc6f4 req-e565fa71-f169-4921-ba9f-63d85b8d215b tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0472519
Jun 01 10:14:00.351208 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:00.392322 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4380f001-d68d-4a06-a0ed-d9cc468684dd admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:00.406514 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-4380f001-d68d-4a06-a0ed-d9cc468684dd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:14:00.410411 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-4380f001-d68d-4a06-a0ed-d9cc468684dd admin admin] Usage tracker for resource:security_group_rule and tenant:4422791fc0434585bee3abb0641fbcc0 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:14:00.413202 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-4380f001-d68d-4a06-a0ed-d9cc468684dd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:14:00.418997 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-4380f001-d68d-4a06-a0ed-d9cc468684dd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:14:00.494522 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Allocated IP 172.27.2.28 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/acccd76e-4190-45f1-9b7d-5a4b80879793) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:14:00.499830 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4380f001-d68d-4a06-a0ed-d9cc468684dd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:00.602854 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4380f001-d68d-4a06-a0ed-d9cc468684dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:00.611596 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-76bf3392-1a06-4c8a-809d-0ead6896647a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:00.641428 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:00.650861 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-4380f001-d68d-4a06-a0ed-d9cc468684dd admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=4422791fc0434585bee3abb0641fbcc0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3820376
Jun 01 10:14:00.652793 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4380f001-d68d-4a06-a0ed-d9cc468684dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=694cb265-b151-48c9-8652-e6f65e2ed223,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:00.655117 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37890) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:00.657595 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-4380f001-d68d-4a06-a0ed-d9cc468684dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:00.716869 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b8547256-03ec-4c0b-8c99-f91828131a49 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:00.729069 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:00.733893 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-2d6fc1f1-a0a7-435a-9d62-f792f207b396 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:00.743381 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b8547256-03ec-4c0b-8c99-f91828131a49 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:00.804622 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:14:00.807542 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:14:00.811078 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:14:00.845102 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event updated for resources: {'Port': ['ID=acccd76e-4190-45f1-9b7d-5a4b80879793,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:00.849246 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:00.867536 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b8547256-03ec-4c0b-8c99-f91828131a49 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:00.872432 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-4380f001-d68d-4a06-a0ed-d9cc468684dd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:00.885666 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8547256-03ec-4c0b-8c99-f91828131a49 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=694cb265-b151-48c9-8652-e6f65e2ed223,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:00.888334 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b8547256-03ec-4c0b-8c99-f91828131a49 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:00.889535 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b8547256-03ec-4c0b-8c99-f91828131a49 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:00.893296 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-b8547256-03ec-4c0b-8c99-f91828131a49 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/694cb265-b151-48c9-8652-e6f65e2ed223 HTTP/1.1" status: 204  len: 168 time: 0.2346375
Jun 01 10:14:01.234156 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:01.427194 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:01.504919 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a29f55-560f-4594-bbd4-95b71d4b1f32 req-8586f276-fd28-46c1-9b70-71f2a531f316 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:01.506509 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d4a29f55-560f-4594-bbd4-95b71d4b1f32 req-8586f276-fd28-46c1-9b70-71f2a531f316 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 946 time: 0.0899410
Jun 01 10:14:01.558763 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d4a29f55-560f-4594-bbd4-95b71d4b1f32 req-78ea8f00-0147-446e-9743-c20e6e8625eb tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0461814
Jun 01 10:14:01.587623 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37900) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:01.608404 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4690d2f8-deed-438f-871e-0966b65cef44 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:01.663913 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-4690d2f8-deed-438f-871e-0966b65cef44 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:14:01.670166 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-4690d2f8-deed-438f-871e-0966b65cef44 admin admin] Usage tracker for resource:security_group_rule and tenant:eed6c1f8541447c3a3f1e5b5a21f271d is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:14:01.677487 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-4690d2f8-deed-438f-871e-0966b65cef44 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:14:01.685602 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-4690d2f8-deed-438f-871e-0966b65cef44 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:14:01.739086 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-338b2764-fe6a-4e7f-b312-2b537a18fd3e req-5a36320b-5b2d-415a-ade6-4227abfe0e24 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:01.739892 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:01.740495 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-338b2764-fe6a-4e7f-b312-2b537a18fd3e req-5a36320b-5b2d-415a-ade6-4227abfe0e24 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.30 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 946 time: 0.1205568
Jun 01 10:14:01.825604 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2295697'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:01.829809 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-86ed2692-d65b-4cb9-bae2-83a9122cd7f2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:01.895835 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4690d2f8-deed-438f-871e-0966b65cef44 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:01.927404 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-338b2764-fe6a-4e7f-b312-2b537a18fd3e req-f393bb37-0565-4c87-9b7a-e73290817fec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Deleting port 15ce50f0-fa11-464b-a55e-f6f214c49154 {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:14:01.927750 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-338b2764-fe6a-4e7f-b312-2b537a18fd3e req-f393bb37-0565-4c87-9b7a-e73290817fec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:01.943378 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event updated for resources: {'Port': ['ID=acccd76e-4190-45f1-9b7d-5a4b80879793,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:01.949619 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:01.949904 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4690d2f8-deed-438f-871e-0966b65cef44 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:01.954621 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:02.003558 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7cd5261b-5b53-4509-809c-34ec65a33242 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:02.063220 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-4690d2f8-deed-438f-871e-0966b65cef44 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=eed6c1f8541447c3a3f1e5b5a21f271d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4717128
Jun 01 10:14:02.064120 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37904) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:02.068602 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4690d2f8-deed-438f-871e-0966b65cef44 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b56705e6-134d-4426-8dee-fbe81d792a41,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:02.084686 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-4690d2f8-deed-438f-871e-0966b65cef44 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:02.128617 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.l3_db [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Floating IP 8dda3024-052e-4587-8448-6acdc53d117b associated. External IP: 172.27.2.28, port: 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea.
Jun 01 10:14:02.149206 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-338b2764-fe6a-4e7f-b312-2b537a18fd3e req-f393bb37-0565-4c87-9b7a-e73290817fec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] For port 15ce50f0-fa11-464b-a55e-f6f214c49154, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=15ce50f0-fa11-464b-a55e-f6f214c49154,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:14:02.149480 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-338b2764-fe6a-4e7f-b312-2b537a18fd3e req-f393bb37-0565-4c87-9b7a-e73290817fec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:02.247560 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2082f672-9b53-463d-9c6c-fa5c9d4db66a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:02.347808 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2082f672-9b53-463d-9c6c-fa5c9d4db66a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:02.494624 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Router 426524f6-17bf-45cb-b42b-2fec9e039ff0 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:14:02.580154 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-338b2764-fe6a-4e7f-b312-2b537a18fd3e req-f393bb37-0565-4c87-9b7a-e73290817fec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for floatingip, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:02.580521 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-338b2764-fe6a-4e7f-b312-2b537a18fd3e req-f393bb37-0565-4c87-9b7a-e73290817fec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:02.580834 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.l3_db [req-338b2764-fe6a-4e7f-b312-2b537a18fd3e req-f393bb37-0565-4c87-9b7a-e73290817fec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Floating IP ce6e5c86-9a91-4cb6-b81e-e0abdda4ee16 disassociated. External IP: 172.27.2.136, port: 15ce50f0-fa11-464b-a55e-f6f214c49154.
Jun 01 10:14:02.581176 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-338b2764-fe6a-4e7f-b312-2b537a18fd3e req-f393bb37-0565-4c87-9b7a-e73290817fec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Calling delete_port for 15ce50f0-fa11-464b-a55e-f6f214c49154 owned by compute:nova {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:14:02.669470 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2082f672-9b53-463d-9c6c-fa5c9d4db66a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:02.675626 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-4690d2f8-deed-438f-871e-0966b65cef44 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:02.677281 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:14:02.691811 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7565854f-a1c3-4cbe-97f9-640cb6372ff9 None None] Sync routers for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:14:02.701248 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7565854f-a1c3-4cbe-97f9-640cb6372ff9 None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:14:02.702115 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-7565854f-a1c3-4cbe-97f9-640cb6372ff9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72a381c0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:13:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:14:02.727053 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2082f672-9b53-463d-9c6c-fa5c9d4db66a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b56705e6-134d-4426-8dee-fbe81d792a41,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:02.737137 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-2082f672-9b53-463d-9c6c-fa5c9d4db66a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:02.778936 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2082f672-9b53-463d-9c6c-fa5c9d4db66a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:02.780040 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-2082f672-9b53-463d-9c6c-fa5c9d4db66a admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/b56705e6-134d-4426-8dee-fbe81d792a41 HTTP/1.1" status: 204  len: 168 time: 0.7127342
Jun 01 10:14:02.797673 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:02.804907 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ee204f5-cc46-4220-92a2-ee2b653eccd3 req-d69aac3f-1dee-4613-8f13-5badea145888 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:02.805955 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-8ee204f5-cc46-4220-92a2-ee2b653eccd3 req-d69aac3f-1dee-4613-8f13-5badea145888 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Synchronizing usage tracker for tenant:f4f6f875519045a39c1fdbadd53ce517 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:14:02.861835 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 995 time: 2.7688920
Jun 01 10:14:02.862646 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'tag': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:14:02.865370 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ded575e7-f982-4136-9b96-e481d65f8dba" -d '{"events": [{"name": "network-changed", "server_uuid": "00b98054-6f11-49b6-b07f-3178e4e5472d", "tag": "7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:14:02.888495 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-338b2764-fe6a-4e7f-b312-2b537a18fd3e req-f393bb37-0565-4c87-9b7a-e73290817fec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:02.899222 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-3bf97410-0302-4351-8423-03fe73c11d15 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:02.906045 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-7565854f-a1c3-4cbe-97f9-640cb6372ff9 None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:14:02.925465 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:14:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bbc14497-2626-4e04-93cb-1b0aed0ef1ce x-openstack-request-id: req-bbc14497-2626-4e04-93cb-1b0aed0ef1ce {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:14:02.925891 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "00b98054-6f11-49b6-b07f-3178e4e5472d", "tag": "7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:14:02.926317 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-bbc14497-2626-4e04-93cb-1b0aed0ef1ce {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:14:02.926851 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'tag': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea', 'status': 'completed', 'code': 200}
Jun 01 10:14:02.950619 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-8ee204f5-cc46-4220-92a2-ee2b653eccd3 req-d69aac3f-1dee-4613-8f13-5badea145888 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Unset dirty status for tenant:f4f6f875519045a39c1fdbadd53ce517 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:14:02.951961 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8ee204f5-cc46-4220-92a2-ee2b653eccd3 req-d69aac3f-1dee-4613-8f13-5badea145888 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 946 time: 0.2694483
Jun 01 10:14:02.978381 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f393bb37-0565-4c87-9b7a-e73290817fec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event deleted for resources: {'Port': ['ID=15ce50f0-fa11-464b-a55e-f6f214c49154,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:02.981778 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f393bb37-0565-4c87-9b7a-e73290817fec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:03.033001 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ded575e7-f982-4136-9b96-e481d65f8dba req-d7c66e30-9f28-4d1c-abc8-f591ef45a487 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:03.034534 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-ded575e7-f982-4136-9b96-e481d65f8dba req-d7c66e30-9f28-4d1c-abc8-f591ef45a487 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 1098 time: 0.0863347
Jun 01 10:14:03.100628 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8ee204f5-cc46-4220-92a2-ee2b653eccd3 req-96600d39-59bc-4aff-838c-cead14bf30d8 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups?id=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1367257
Jun 01 10:14:03.190256 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ded575e7-f982-4136-9b96-e481d65f8dba req-e61f806e-5898-4937-a983-bf130a4ef566 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:03.191673 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-ded575e7-f982-4136-9b96-e481d65f8dba req-e61f806e-5898-4937-a983-bf130a4ef566 service neutron] 10.222.0.30 "GET /v2.0/networks?id=83aff072-8820-4a36-b8f3-036a7011aace HTTP/1.1" status: 200  len: 910 time: 0.1492529
Jun 01 10:14:03.221702 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [req-338b2764-fe6a-4e7f-b312-2b537a18fd3e req-f393bb37-0565-4c87-9b7a-e73290817fec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Router d65374d4-451b-4890-a2f5-a4bcac5a9a38 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92566) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:14:03.344519 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-7565854f-a1c3-4cbe-97f9-640cb6372ff9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72a381c0>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '8dda3024-052e-4587-8448-6acdc53d117b', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'floating_ip_address': '172.27.2.28', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'port_id': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'mac_address': 'fa:16:3e:21:3e:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:14:01Z', 'updated_at': '2021-06-01T10:14:01Z', 'revision_number': 0, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:14:03.349707 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7565854f-a1c3-4cbe-97f9-640cb6372ff9 None None] Checking router: 426524f6-17bf-45cb-b42b-2fec9e039ff0 for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:14:03.369964 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7565854f-a1c3-4cbe-97f9-640cb6372ff9 None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:14:03.369964 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-7565854f-a1c3-4cbe-97f9-640cb6372ff9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72a381c0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:13:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:14:03.461372 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-ded575e7-f982-4136-9b96-e481d65f8dba req-df99ffa7-e310-49d0-9b7d-b5b2700dde7c service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea HTTP/1.1" status: 200  len: 998 time: 0.2616274
Jun 01 10:14:03.477960 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-338b2764-fe6a-4e7f-b312-2b537a18fd3e req-f393bb37-0565-4c87-9b7a-e73290817fec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:14:03.487807 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36734ab4-7e2c-471b-999b-e7de02ab581a None None] Sync routers for ids ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:14:03.514790 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36734ab4-7e2c-471b-999b-e7de02ab581a None None] Routers {'d65374d4-451b-4890-a2f5-a4bcac5a9a38'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:14:03.518077 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-36734ab4-7e2c-471b-999b-e7de02ab581a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7253f070>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:13:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:14:03.562960 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ded575e7-f982-4136-9b96-e481d65f8dba req-4c525685-f6b4-497e-9e92-a2646e7f6bef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:03.564382 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-ded575e7-f982-4136-9b96-e481d65f8dba req-4c525685-f6b4-497e-9e92-a2646e7f6bef service neutron] 10.222.0.30 "GET /v2.0/subnets?id=38dbf18a-9bde-4c4a-b149-d02ad12671d3 HTTP/1.1" status: 200  len: 848 time: 0.0963848
Jun 01 10:14:03.605880 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-338b2764-fe6a-4e7f-b312-2b537a18fd3e req-f393bb37-0565-4c87-9b7a-e73290817fec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] No DVR routers for this DVR port 15ce50f0-fa11-464b-a55e-f6f214c49154 on host hv-cinder-78726 {{(pid=92566) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:14:03.611887 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-338b2764-fe6a-4e7f-b312-2b537a18fd3e req-f393bb37-0565-4c87-9b7a-e73290817fec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:03.614167 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-338b2764-fe6a-4e7f-b312-2b537a18fd3e req-f393bb37-0565-4c87-9b7a-e73290817fec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.30 "DELETE /v2.0/ports/15ce50f0-fa11-464b-a55e-f6f214c49154 HTTP/1.1" status: 204  len: 173 time: 1.8668482
Jun 01 10:14:03.614680 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0043671-b417-407f-944f-21d4e3af4137', 'name': 'network-vif-deleted', 'tag': '15ce50f0-fa11-464b-a55e-f6f214c49154'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:14:03.618155 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-078b70e7-eaa0-4960-8068-94e8eb049940" -d '{"events": [{"server_uuid": "e0043671-b417-407f-944f-21d4e3af4137", "name": "network-vif-deleted", "tag": "15ce50f0-fa11-464b-a55e-f6f214c49154"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:14:03.646193 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-7565854f-a1c3-4cbe-97f9-640cb6372ff9 None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:14:03.673381 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:14:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-144270a6-20e3-40ee-82d7-1542cf58e2d1 x-openstack-request-id: req-144270a6-20e3-40ee-82d7-1542cf58e2d1 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:14:03.673692 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e0043671-b417-407f-944f-21d4e3af4137", "name": "network-vif-deleted", "tag": "15ce50f0-fa11-464b-a55e-f6f214c49154", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:14:03.673990 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-144270a6-20e3-40ee-82d7-1542cf58e2d1 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:14:03.674390 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e0043671-b417-407f-944f-21d4e3af4137', 'name': 'network-vif-deleted', 'tag': '15ce50f0-fa11-464b-a55e-f6f214c49154', 'status': 'completed', 'code': 200}
Jun 01 10:14:03.683035 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ded575e7-f982-4136-9b96-e481d65f8dba req-ab15655a-b473-4ee2-93bc-5f19214bf019 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:03.685250 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-ded575e7-f982-4136-9b96-e481d65f8dba req-ab15655a-b473-4ee2-93bc-5f19214bf019 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=83aff072-8820-4a36-b8f3-036a7011aace&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1114094
Jun 01 10:14:03.799010 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-36734ab4-7e2c-471b-999b-e7de02ab581a None None] Set router d65374d4-451b-4890-a2f5-a4bcac5a9a38 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:14:03.852820 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-ded575e7-f982-4136-9b96-e481d65f8dba req-3a526b27-efb1-49d9-a0e6-2fd41c8853c3 service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1608956
Jun 01 10:14:04.024577 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-ded575e7-f982-4136-9b96-e481d65f8dba req-0e1d7780-ae58-4fab-b2ea-74aa04a785e5 service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1634312
Jun 01 10:14:04.159912 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-7565854f-a1c3-4cbe-97f9-640cb6372ff9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72a381c0>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '8dda3024-052e-4587-8448-6acdc53d117b', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'floating_ip_address': '172.27.2.28', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'port_id': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'mac_address': 'fa:16:3e:21:3e:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:14:01Z', 'updated_at': '2021-06-01T10:14:01Z', 'revision_number': 0, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:14:04.164971 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7565854f-a1c3-4cbe-97f9-640cb6372ff9 None None] The sync data for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi is: [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '8dda3024-052e-4587-8448-6acdc53d117b', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'floating_ip_address': '172.27.2.28', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'port_id': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'mac_address': 'fa:16:3e:21:3e:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:14:01Z', 'updated_at': '2021-06-01T10:14:01Z', 'revision_number': 0, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:14:04.214409 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-36734ab4-7e2c-471b-999b-e7de02ab581a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7253f070>, [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:18Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '476d2473-d40f-4cca-8a85-8b1ea30a5281', 'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'mac_address': 'fa:16:3e:87:a6:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:15Z', 'updated_at': '2021-06-01T10:06:36Z', 'revision_number': 5, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'subnets': [{'id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:14:04.220250 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36734ab4-7e2c-471b-999b-e7de02ab581a None None] Checking router: d65374d4-451b-4890-a2f5-a4bcac5a9a38 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:14:04.230400 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36734ab4-7e2c-471b-999b-e7de02ab581a None None] Routers {'d65374d4-451b-4890-a2f5-a4bcac5a9a38'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:14:04.231070 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-36734ab4-7e2c-471b-999b-e7de02ab581a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7253f070>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:13:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:14:04.341415 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fc04b0d2-e713-436f-8c56-2124acd31cc5 req-65e88630-1e85-428f-b591-59b428e029e9 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/ports?device_id=e0043671-b417-407f-944f-21d4e3af4137 HTTP/1.1" status: 200  len: 210 time: 0.0486119
Jun 01 10:14:04.438186 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-36734ab4-7e2c-471b-999b-e7de02ab581a None None] Set router d65374d4-451b-4890-a2f5-a4bcac5a9a38 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:14:04.449068 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-800362a3-968f-4026-b96d-ae5b50a26995 None None] New status for floating IP 8dda3024-052e-4587-8448-6acdc53d117b: ACTIVE {{(pid=92568) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:14:04.797234 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-36734ab4-7e2c-471b-999b-e7de02ab581a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7253f070>, [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:18Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '476d2473-d40f-4cca-8a85-8b1ea30a5281', 'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'mac_address': 'fa:16:3e:87:a6:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:15Z', 'updated_at': '2021-06-01T10:06:36Z', 'revision_number': 5, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'subnets': [{'id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:14:04.801275 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36734ab4-7e2c-471b-999b-e7de02ab581a None None] The sync data for ids ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'] in dv-cinder-787262-4-iscsi is: [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:06:18Z', 'revision_number': 4, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '476d2473-d40f-4cca-8a85-8b1ea30a5281', 'name': '', 'network_id': 'be546533-cf92-483d-9e38-7d14ca9c4902', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'mac_address': 'fa:16:3e:87:a6:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:15Z', 'updated_at': '2021-06-01T10:06:36Z', 'revision_number': 5, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'subnets': [{'id': 'f2fdda64-a03c-41d7-8178-daca0363bd6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:14:05.031138 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1af0d622-7b52-4f9b-b519-6cd1bde3d84d None None] New status for floating IP ce6e5c86-9a91-4cb6-b81e-e0abdda4ee16: DOWN {{(pid=92567) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:14:05.419015 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 15ce50f0-fa11-464b-a55e-f6f214c49154 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:14:05.457697 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: 15ce50f0-fa11-464b-a55e-f6f214c49154 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:14:05.458058 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 15ce50f0-fa11-464b-a55e-f6f214c49154 not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:14:05.532011 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37968) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:05.600730 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7d53ac44-7c87-4386-ad21-ccc526e69e7a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:05.629111 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7d53ac44-7c87-4386-ad21-ccc526e69e7a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:05.758834 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7d53ac44-7c87-4386-ad21-ccc526e69e7a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:05.763686 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b26ba7d8-8c47-4adf-9132-8744c2ce5c82 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:05.778437 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d53ac44-7c87-4386-ad21-ccc526e69e7a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0a1ee7c6-132b-4e91-9d58-cd0c0ebba815,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:05.781583 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7d53ac44-7c87-4386-ad21-ccc526e69e7a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:05.849292 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7d53ac44-7c87-4386-ad21-ccc526e69e7a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:05.850447 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-7d53ac44-7c87-4386-ad21-ccc526e69e7a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "DELETE /v2.0/security-groups/0a1ee7c6-132b-4e91-9d58-cd0c0ebba815 HTTP/1.1" status: 204  len: 168 time: 0.3174410
Jun 01 10:14:05.853473 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 37974) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:05.870824 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.api.v2.resource [None req-703349ba-2fe7-4acf-874f-96415f98b838 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] show failed (client error): The resource could not be found.
Jun 01 10:14:05.874058 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-703349ba-2fe7-4acf-874f-96415f98b838 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "GET /v2.0/security-groups/0a1ee7c6-132b-4e91-9d58-cd0c0ebba815 HTTP/1.1" status: 404  len: 347 time: 0.0168040
Jun 01 10:14:05.876266 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 37978) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:06.098795 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-1304e7f8-539d-46b5-b24b-db75465bbe55 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Deleting port bc58c3ee-72d2-4eb7-b6c5-cfd054f1ee53 {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:14:06.099255 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1304e7f8-539d-46b5-b24b-db75465bbe55 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:06.220018 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1304e7f8-539d-46b5-b24b-db75465bbe55 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:06.220353 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1304e7f8-539d-46b5-b24b-db75465bbe55 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:06.429765 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-1304e7f8-539d-46b5-b24b-db75465bbe55 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Calling delete_port for bc58c3ee-72d2-4eb7-b6c5-cfd054f1ee53 owned by network:floatingip {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:14:06.604860 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1304e7f8-539d-46b5-b24b-db75465bbe55 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:06.608508 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f393bb37-0565-4c87-9b7a-e73290817fec tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:06.650804 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1304e7f8-539d-46b5-b24b-db75465bbe55 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Pushing event deleted for resources: {'Port': ['ID=bc58c3ee-72d2-4eb7-b6c5-cfd054f1ee53,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:06.653857 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1304e7f8-539d-46b5-b24b-db75465bbe55 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:06.741969 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1304e7f8-539d-46b5-b24b-db75465bbe55 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks [] for floatingip, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:06.821144 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1304e7f8-539d-46b5-b24b-db75465bbe55 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:06.822288 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-1304e7f8-539d-46b5-b24b-db75465bbe55 tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] 10.222.0.68 "DELETE /v2.0/floatingips/ce6e5c86-9a91-4cb6-b81e-e0abdda4ee16 HTTP/1.1" status: 204  len: 168 time: 0.9450555
Jun 01 10:14:08.288269 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fcbf96e-62e7-4337-b80a-732038fca356 req-3519239a-8fb2-4b42-8bc4-9be7311d377c tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:08.291015 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8fcbf96e-62e7-4337-b80a-732038fca356 req-3519239a-8fb2-4b42-8bc4-9be7311d377c tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 985 time: 0.1020262
Jun 01 10:14:08.331101 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07b70cce-bf0f-4966-85b6-ed126823d822 req-f4d30409-44d9-4ffc-b40a-b011141204da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:08.332591 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-07b70cce-bf0f-4966-85b6-ed126823d822 req-f4d30409-44d9-4ffc-b40a-b011141204da service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=42ccd1aa89a94252b32a254cead654ef&device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 1138 time: 0.0826676
Jun 01 10:14:08.342313 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8fcbf96e-62e7-4337-b80a-732038fca356 req-e7f1ba4d-713c-41ae-8304-7cffbf86567e tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&id=84f2a1e4-cc30-4691-8e14-0c27546b9656&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0454214
Jun 01 10:14:08.487786 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07b70cce-bf0f-4966-85b6-ed126823d822 req-f1c18d7f-8638-439b-896c-07c26fdc972f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:08.489495 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-07b70cce-bf0f-4966-85b6-ed126823d822 req-f1c18d7f-8638-439b-896c-07c26fdc972f service neutron] 10.222.0.30 "GET /v2.0/networks?id=d11181a0-389a-4fe3-b44f-805e01bb81e5 HTTP/1.1" status: 200  len: 916 time: 0.1495998
Jun 01 10:14:08.594437 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-07b70cce-bf0f-4966-85b6-ed126823d822 req-5a226346-7a69-44ea-b054-a0076b1bdffa service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=14a54ac6-61b8-43e2-b571-8a9993ebd80c HTTP/1.1" status: 200  len: 1002 time: 0.0974729
Jun 01 10:14:08.657086 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07b70cce-bf0f-4966-85b6-ed126823d822 req-bd016363-cff7-49d4-959e-3bcdc339a70a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:08.658417 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-07b70cce-bf0f-4966-85b6-ed126823d822 req-bd016363-cff7-49d4-959e-3bcdc339a70a service neutron] 10.222.0.30 "GET /v2.0/subnets?id=dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9 HTTP/1.1" status: 200  len: 854 time: 0.0572054
Jun 01 10:14:08.740683 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07b70cce-bf0f-4966-85b6-ed126823d822 req-6fed784e-8db5-4773-95be-dce9f6a9358a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:08.744770 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-07b70cce-bf0f-4966-85b6-ed126823d822 req-6fed784e-8db5-4773-95be-dce9f6a9358a service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=d11181a0-389a-4fe3-b44f-805e01bb81e5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0768747
Jun 01 10:14:08.889599 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-07b70cce-bf0f-4966-85b6-ed126823d822 req-10655735-4169-4cd8-a6ee-b73893956f81 service neutron] 10.222.0.30 "GET /v2.0/networks/d11181a0-389a-4fe3-b44f-805e01bb81e5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1395729
Jun 01 10:14:09.026870 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-07b70cce-bf0f-4966-85b6-ed126823d822 req-cb1e3e26-5b9f-4e5c-bbe5-6d6a20befe29 service neutron] 10.222.0.30 "GET /v2.0/networks/d11181a0-389a-4fe3-b44f-805e01bb81e5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1272337
Jun 01 10:14:09.530220 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bfdac26-80dc-4109-9640-0dc64dee6aa5 req-9018ee20-bbce-485d-85ed-6d942dff102d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:09.531891 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3bfdac26-80dc-4109-9640-0dc64dee6aa5 req-9018ee20-bbce-485d-85ed-6d942dff102d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 985 time: 0.0835135
Jun 01 10:14:09.579943 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3bfdac26-80dc-4109-9640-0dc64dee6aa5 req-b6b6d6d1-1872-4da0-a3a1-5efb85620b9d tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&id=84f2a1e4-cc30-4691-8e14-0c27546b9656&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0420175
Jun 01 10:14:09.982640 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 38028) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:10.467345 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-73adba7a-c692-4b77-896b-094c14117f71 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:10.790277 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ab8b015-ad7c-4c14-a966-015999525add req-0147fa5e-63ff-423f-870f-c496bff899f7 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:10.792398 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7ab8b015-ad7c-4c14-a966-015999525add req-0147fa5e-63ff-423f-870f-c496bff899f7 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 985 time: 0.1001730
Jun 01 10:14:10.794721 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-43670c50-1997-4a50-a23e-b417cd6b836e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-401846'] for router_interface, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:10.844700 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7ab8b015-ad7c-4c14-a966-015999525add req-42805556-5b95-4319-84aa-517dfdbc680c tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&id=84f2a1e4-cc30-4691-8e14-0c27546b9656&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0455990
Jun 01 10:14:11.208304 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-43670c50-1997-4a50-a23e-b417cd6b836e admin admin] Deleting port 476d2473-d40f-4cca-8a85-8b1ea30a5281 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:14:11.208304 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-43670c50-1997-4a50-a23e-b417cd6b836e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:11.330682 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-43670c50-1997-4a50-a23e-b417cd6b836e admin admin] For port 476d2473-d40f-4cca-8a85-8b1ea30a5281, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=476d2473-d40f-4cca-8a85-8b1ea30a5281,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:14:11.331064 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-43670c50-1997-4a50-a23e-b417cd6b836e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:11.457952 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-43670c50-1997-4a50-a23e-b417cd6b836e admin admin] Calling delete_port for 476d2473-d40f-4cca-8a85-8b1ea30a5281 owned by network:router_interface {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:14:11.660077 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-43670c50-1997-4a50-a23e-b417cd6b836e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:11.664784 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-0da19500-e328-4a68-8a6c-4ff27669b8ef service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:11.714993 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43670c50-1997-4a50-a23e-b417cd6b836e admin admin] Pushing event deleted for resources: {'Port': ['ID=476d2473-d40f-4cca-8a85-8b1ea30a5281,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:11.746437 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-43670c50-1997-4a50-a23e-b417cd6b836e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:11.981435 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-43670c50-1997-4a50-a23e-b417cd6b836e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7875317', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-405030'] for router_interface, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:12.032843 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45d46169-a0e7-487c-b2a7-2de6320ee682 req-0efdccb6-2622-4bb8-a6b3-18661baf24ef tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:12.034195 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-45d46169-a0e7-487c-b2a7-2de6320ee682 req-0efdccb6-2622-4bb8-a6b3-18661baf24ef tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 985 time: 0.0807784
Jun 01 10:14:12.085231 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-45d46169-a0e7-487c-b2a7-2de6320ee682 req-16584a8b-0461-47a7-9da9-396da82beb65 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&id=84f2a1e4-cc30-4691-8e14-0c27546b9656&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0450046
Jun 01 10:14:12.443504 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-43670c50-1997-4a50-a23e-b417cd6b836e admin admin] Router d65374d4-451b-4890-a2f5-a4bcac5a9a38 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:14:12.624122 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-43670c50-1997-4a50-a23e-b417cd6b836e admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:14:12.633385 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2030f6d4-18c8-459a-a6a6-b6cb6e026511 None None] Sync routers for ids ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:14:12.636469 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-43670c50-1997-4a50-a23e-b417cd6b836e admin admin] 10.222.0.68 "PUT /v2.0/routers/d65374d4-451b-4890-a2f5-a4bcac5a9a38/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6525097
Jun 01 10:14:12.638921 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 38072) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:12.643383 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2030f6d4-18c8-459a-a6a6-b6cb6e026511 None None] Routers {'d65374d4-451b-4890-a2f5-a4bcac5a9a38'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:14:12.643985 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-2030f6d4-18c8-459a-a6a6-b6cb6e026511 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe728bf910>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:13:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:14:12.818471 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] Notify callbacks [] for router, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:12.840227 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-2030f6d4-18c8-459a-a6a6-b6cb6e026511 None None] Set router d65374d4-451b-4890-a2f5-a4bcac5a9a38 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:14:12.997477 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:13.010247 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-69efba55-7411-4383-8050-5b2c3294cbc0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:13.157065 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-2030f6d4-18c8-459a-a6a6-b6cb6e026511 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe728bf910>, [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236'}], 'enable_snat': True}, 'gw_port_id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:14:11Z', 'revision_number': 5, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port': {'id': '5a1ced49-9531-4fcc-b7ac-004241b95c6b', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:f8:b9:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:06:07Z', 'updated_at': '2021-06-01T10:06:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:14:13.161140 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2030f6d4-18c8-459a-a6a6-b6cb6e026511 None None] Checking router: d65374d4-451b-4890-a2f5-a4bcac5a9a38 for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:14:13.171376 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2030f6d4-18c8-459a-a6a6-b6cb6e026511 None None] Routers {'d65374d4-451b-4890-a2f5-a4bcac5a9a38'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:14:13.171983 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-2030f6d4-18c8-459a-a6a6-b6cb6e026511 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe728bf910>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:14:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:14:13.186033 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] Deleting port 5a1ced49-9531-4fcc-b7ac-004241b95c6b {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:14:13.186397 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:13.268127 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:13.303357 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e14a921-8da4-4576-b331-65bed2f7fc64 req-30937f2d-dcd7-4a0e-85cc-1f5edc21b334 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:13.304865 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7e14a921-8da4-4576-b331-65bed2f7fc64 req-30937f2d-dcd7-4a0e-85cc-1f5edc21b334 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 985 time: 0.0888305
Jun 01 10:14:13.323573 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] For port 5a1ced49-9531-4fcc-b7ac-004241b95c6b, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=5a1ced49-9531-4fcc-b7ac-004241b95c6b,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:14:13.324079 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:13.343570 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-2030f6d4-18c8-459a-a6a6-b6cb6e026511 None None] Set router d65374d4-451b-4890-a2f5-a4bcac5a9a38 gateway port host: None {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:14:13.355818 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7e14a921-8da4-4576-b331-65bed2f7fc64 req-39c93056-1676-447f-bd44-7ea88df454b6 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&id=84f2a1e4-cc30-4691-8e14-0c27546b9656&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0441778
Jun 01 10:14:13.457303 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] Calling delete_port for 5a1ced49-9531-4fcc-b7ac-004241b95c6b owned by network:router_gateway {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:14:13.486656 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-2030f6d4-18c8-459a-a6a6-b6cb6e026511 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe728bf910>, [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:14:12Z', 'revision_number': 6, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port_host': None}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:14:13.493218 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2030f6d4-18c8-459a-a6a6-b6cb6e026511 None None] The sync data for ids ['d65374d4-451b-4890-a2f5-a4bcac5a9a38'] in dv-cinder-787262-4-iscsi is: [{'id': 'd65374d4-451b-4890-a2f5-a4bcac5a9a38', 'name': 'tempest-AttachVolumeShelveTestJSON-156424351-router', 'tenant_id': 'f4f6f875519045a39c1fdbadd53ce517', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:06:05Z', 'updated_at': '2021-06-01T10:14:12Z', 'revision_number': 6, 'project_id': 'f4f6f875519045a39c1fdbadd53ce517', 'gw_port_host': None}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:14:13.691174 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:13.696861 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-dd901936-54a7-4b37-b286-df8318b24fba tempest-VolumesSnapshotTestJSON-1696842158 tempest-VolumesSnapshotTestJSON-1696842158-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:13.700834 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 476d2473-d40f-4cca-8a85-8b1ea30a5281 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:14:13.743662 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: 476d2473-d40f-4cca-8a85-8b1ea30a5281 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:14:13.744162 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 476d2473-d40f-4cca-8a85-8b1ea30a5281 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:14:13.855574 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] Pushing event deleted for resources: {'Port': ['ID=5a1ced49-9531-4fcc-b7ac-004241b95c6b,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:13.858838 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:13.957278 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-403627'] for router_gateway, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:14.054782 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:14.144928 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-405542', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-15816'] for router, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:14.147318 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:14.290319 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-406042'] for router, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:14.290748 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d65374d4-451b-4890-a2f5-a4bcac5a9a38 {{(pid=92565) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 10:14:14.303201 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] Notify callbacks [] for router, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:14.304659 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] 10.222.0.68 "DELETE /v2.0/routers/d65374d4-451b-4890-a2f5-a4bcac5a9a38 HTTP/1.1" status: 204  len: 168 time: 1.6647325
Jun 01 10:14:14.307574 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 38098) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:14.373217 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_v2 [None req-c59d3e16-199b-4f77-a59d-8d11bd46f823 admin admin] Deleting subnet f2fdda64-a03c-41d7-8178-daca0363bd6e {{(pid=92565) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 10:14:14.376853 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c59d3e16-199b-4f77-a59d-8d11bd46f823 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:14.432386 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c59d3e16-199b-4f77-a59d-8d11bd46f823 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2998467'] for subnet, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:14.516978 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c59d3e16-199b-4f77-a59d-8d11bd46f823 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7791835'] for subnet, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:14.557121 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdfe47b1-867c-4088-9328-d86d85e0a8e4 req-f0ed8591-7e24-4190-937c-fda6298908ce tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:14.558569 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bdfe47b1-867c-4088-9328-d86d85e0a8e4 req-f0ed8591-7e24-4190-937c-fda6298908ce tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 985 time: 0.0843859
Jun 01 10:14:14.605311 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bdfe47b1-867c-4088-9328-d86d85e0a8e4 req-8fa1986a-6ac2-423c-8c14-806c0eb41413 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&id=84f2a1e4-cc30-4691-8e14-0c27546b9656&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0409236
Jun 01 10:14:14.839314 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c59d3e16-199b-4f77-a59d-8d11bd46f823 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7793006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2233195', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3139387'] for subnet, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:14.843330 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:14.881973 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c59d3e16-199b-4f77-a59d-8d11bd46f823 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f2fdda64-a03c-41d7-8178-daca0363bd6e,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:14.885076 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c59d3e16-199b-4f77-a59d-8d11bd46f823 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:14.886049 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c59d3e16-199b-4f77-a59d-8d11bd46f823 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:14.891975 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a5e9317-df66-4e25-a1aa-7de8a64a21c6 None None] Network be546533-cf92-483d-9e38-7d14ca9c4902 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:14:14.892275 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-c59d3e16-199b-4f77-a59d-8d11bd46f823 admin admin] 10.222.0.68 "DELETE /v2.0/subnets/f2fdda64-a03c-41d7-8178-daca0363bd6e HTTP/1.1" status: 204  len: 168 time: 0.5837388
Jun 01 10:14:14.896412 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 38106) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:15.028093 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7813807'] for network, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:15.102591 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Deleting port 9ae36a44-2229-48a5-8955-f44cea3ffab0 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:14:15.102953 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:15.143662 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd6b8272-f065-49cd-8dfb-89626af5fbe1 None None] DHCP port deletion for be546533-cf92-483d-9e38-7d14ca9c4902 request from dv-cinder-787262-4-iscsi {{(pid=92567) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 10:14:15.210495 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-cd6b8272-f065-49cd-8dfb-89626af5fbe1 None None] Deleting port 9ae36a44-2229-48a5-8955-f44cea3ffab0 {{(pid=92567) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:14:15.210870 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cd6b8272-f065-49cd-8dfb-89626af5fbe1 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:15.220719 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] For port 9ae36a44-2229-48a5-8955-f44cea3ffab0, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=9ae36a44-2229-48a5-8955-f44cea3ffab0,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:14:15.221196 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:15.306889 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-cd6b8272-f065-49cd-8dfb-89626af5fbe1 None None] For port 9ae36a44-2229-48a5-8955-f44cea3ffab0, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=9ae36a44-2229-48a5-8955-f44cea3ffab0,segment=NetworkSegment(718fdfa6-b13d-46f9-85ca-8438bc5d308c),segment_id=718fdfa6-b13d-46f9-85ca-8438bc5d308c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:14:15.307314 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cd6b8272-f065-49cd-8dfb-89626af5fbe1 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:15.349602 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Calling delete_port for 9ae36a44-2229-48a5-8955-f44cea3ffab0 owned by network:dhcp {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:14:15.432209 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-cd6b8272-f065-49cd-8dfb-89626af5fbe1 None None] Calling delete_port for 9ae36a44-2229-48a5-8955-f44cea3ffab0 owned by network:dhcp {{(pid=92567) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:14:15.439117 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:15.444209 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a61b46a1-944c-45e1-ab43-f48050b93c9a tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:15.476831 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cd6b8272-f065-49cd-8dfb-89626af5fbe1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820'] for port, after_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:15.481556 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:15.499711 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Pushing event deleted for resources: {'Port': ['ID=9ae36a44-2229-48a5-8955-f44cea3ffab0,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:15.501629 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] No DVR routers for this DVR port 9ae36a44-2229-48a5-8955-f44cea3ffab0 on host dv-cinder-787262-4-iscsi {{(pid=92565) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:14:15.503123 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:15.525174 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd6b8272-f065-49cd-8dfb-89626af5fbe1 None None] Pushing event deleted for resources: {'Port': ['ID=9ae36a44-2229-48a5-8955-f44cea3ffab0,revision_number=None']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:15.528041 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-cd6b8272-f065-49cd-8dfb-89626af5fbe1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:15.528925 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd6b8272-f065-49cd-8dfb-89626af5fbe1 None None] No DVR routers for this DVR port 9ae36a44-2229-48a5-8955-f44cea3ffab0 on host dv-cinder-787262-4-iscsi {{(pid=92567) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:14:15.706997 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 9ae36a44-2229-48a5-8955-f44cea3ffab0 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:14:15.736888 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7795028', 'neutron.services.segments.db._delete_segments_for_network-8726958294492'] for network, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:15.753873 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: 9ae36a44-2229-48a5-8955-f44cea3ffab0 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:14:15.754277 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 9ae36a44-2229-48a5-8955-f44cea3ffab0 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:14:15.754706 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 5a1ced49-9531-4fcc-b7ac-004241b95c6b no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:14:15.758710 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7efe727a81c0>,) {'filters': {'network_id': ['be546533-cf92-483d-9e38-7d14ca9c4902']}} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:14:15.772190 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7efe727a81c0>, '718fdfa6-b13d-46f9-85ca-8438bc5d308c') {'for_net_delete': True} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:14:15.772825 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7efe727a81c0>, '718fdfa6-b13d-46f9-85ca-8438bc5d308c') {} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:14:15.785367 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726958303133', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2998472'] for segment, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:15.800454 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: 5a1ced49-9531-4fcc-b7ac-004241b95c6b {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:14:15.800454 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 5a1ced49-9531-4fcc-b7ac-004241b95c6b not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:14:15.805356 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:15.813437 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Releasing vlan 861 on physical network physnet1 to pool {{(pid=92565) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 10:14:15.813839 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2295757'] for segment, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:15.815784 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf8df32c-52d7-4bcf-a5b7-d637143449ea req-118c3b72-2756-4218-9c79-288c4fefd514 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:15.817253 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cf8df32c-52d7-4bcf-a5b7-d637143449ea req-118c3b72-2756-4218-9c79-288c4fefd514 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 985 time: 0.0984137
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]: Traceback (most recent call last):
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:     timer()
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:     cb(*args, **kw)
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:     return func(*args, **kwargs)
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:     self._notify()
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:     self.callback(batched_events)
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:     event.method(event)
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:     return f(self, *a, **k)
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._get(url).json()
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self.request(url, 'GET', **kwargs)
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 10:14:15.828093 dv-cinder-787262-4-iscsi neutron-server[92565]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 10:14:15.871951 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cf8df32c-52d7-4bcf-a5b7-d637143449ea req-12bec57c-8988-4644-a096-183610e511ef tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&id=84f2a1e4-cc30-4691-8e14-0c27546b9656&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0460839
Jun 01 10:14:15.905607 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:16.010268 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7795037', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-403638'] for network, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:16.016543 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:16.031448 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:16.042792 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Pushing event deleted for resources: {'Network': ['ID=be546533-cf92-483d-9e38-7d14ca9c4902,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:16.047115 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:16.119617 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] 10.222.0.68 "DELETE /v2.0/networks/be546533-cf92-483d-9e38-7d14ca9c4902 HTTP/1.1" status: 204  len: 168 time: 1.2225711
Jun 01 10:14:16.522008 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 38126) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:16.572611 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-62b3de56-2a3a-4482-aa9d-b9c27a8cdf0b admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=f4f6f875519045a39c1fdbadd53ce517&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0488689
Jun 01 10:14:16.574988 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 38130) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:16.635545 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:16.662032 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:16.787808 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:16.791143 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-6eaf3cc3-17f0-4c29-a66b-3b98bf869fdf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:16.809397 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a27f15a2-b6b3-4fd7-9c0b-eb4385956ca2,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:16.821201 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:16.821646 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:16.822630 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:16.823020 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:16.823381 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:16.823737 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:16.824091 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:16.824496 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:16.824801 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:16.825150 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:16.825513 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:16.825844 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:16.829518 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:16.832032 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:16.833127 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-fa01d9fe-f39d-4bc9-926d-24cdb1a71990 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/a27f15a2-b6b3-4fd7-9c0b-eb4385956ca2 HTTP/1.1" status: 204  len: 168 time: 0.2572680
Jun 01 10:14:17.068078 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d582d9dd-a29f-41a2-b5ce-c83a971652e3 req-610ad027-a539-486a-8bb9-b0cc3cdd5c00 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:17.069755 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d582d9dd-a29f-41a2-b5ce-c83a971652e3 req-610ad027-a539-486a-8bb9-b0cc3cdd5c00 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 985 time: 0.0882704
Jun 01 10:14:17.121884 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d582d9dd-a29f-41a2-b5ce-c83a971652e3 req-a07fdb9b-1f30-4336-b31c-53883b8cd3fa tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&id=84f2a1e4-cc30-4691-8e14-0c27546b9656&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0427995
Jun 01 10:14:17.468888 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:14:18.338498 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-245d9f1d-ab29-4592-989e-a8d98ea2bff0 req-87c41c5e-403b-4223-88fc-a921603a54c9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:18.340048 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-245d9f1d-ab29-4592-989e-a8d98ea2bff0 req-87c41c5e-403b-4223-88fc-a921603a54c9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 985 time: 0.0913217
Jun 01 10:14:18.400312 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-245d9f1d-ab29-4592-989e-a8d98ea2bff0 req-51962fdf-cc95-4e89-921d-f1190d20e6fe tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&id=84f2a1e4-cc30-4691-8e14-0c27546b9656&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0537758
Jun 01 10:14:19.603792 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12798e85-c0d1-4436-b73d-82a808b92fef req-8f7ddf1f-c6b3-4d13-8fc7-d23b604b3c24 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:19.605283 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12798e85-c0d1-4436-b73d-82a808b92fef req-8f7ddf1f-c6b3-4d13-8fc7-d23b604b3c24 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 985 time: 0.0915325
Jun 01 10:14:19.661579 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-12798e85-c0d1-4436-b73d-82a808b92fef req-88700ad3-29ba-4979-b62a-0f87832e35c6 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&id=84f2a1e4-cc30-4691-8e14-0c27546b9656&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0505848
Jun 01 10:14:20.846784 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ac783dd-299a-4fd4-a283-fd86e7638b61 req-3e98040a-8446-499a-8d4c-95f5bff03de6 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:14:20.848323 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3ac783dd-299a-4fd4-a283-fd86e7638b61 req-3e98040a-8446-499a-8d4c-95f5bff03de6 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 985 time: 0.0807433
Jun 01 10:14:20.900668 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-3ac783dd-299a-4fd4-a283-fd86e7638b61 req-a2f78717-8c50-4cd1-86d6-12d8c8129044 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&id=84f2a1e4-cc30-4691-8e14-0c27546b9656&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0453093
Jun 01 10:14:26.387487 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 38300) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:26.504143 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-63889874-287f-4d1f-8968-c9b446deeb46 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:26.507086 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:26.518287 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-63889874-287f-4d1f-8968-c9b446deeb46 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:14:26.522091 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-63889874-287f-4d1f-8968-c9b446deeb46 admin admin] Usage tracker for resource:security_group_rule and tenant:f0b26c916dac47fb832adfec21b1b68c is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:14:26.524873 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-63889874-287f-4d1f-8968-c9b446deeb46 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:14:26.530496 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-63889874-287f-4d1f-8968-c9b446deeb46 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:14:26.610379 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-63889874-287f-4d1f-8968-c9b446deeb46 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:26.701074 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-63889874-287f-4d1f-8968-c9b446deeb46 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:26.709228 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f70c21f2-3651-4eb6-b2b4-bb7a354aacd8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:26.750180 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63889874-287f-4d1f-8968-c9b446deeb46 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=733e4327-f968-4719-912a-193e7da5cf4b,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:26.753585 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-63889874-287f-4d1f-8968-c9b446deeb46 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:26.755895 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-63889874-287f-4d1f-8968-c9b446deeb46 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=f0b26c916dac47fb832adfec21b1b68c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3674176
Jun 01 10:14:26.758591 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 38308) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:26.817245 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1aadead1-b606-4be6-9f6f-5dffd533fa34 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:26.842120 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1aadead1-b606-4be6-9f6f-5dffd533fa34 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:26.980348 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1aadead1-b606-4be6-9f6f-5dffd533fa34 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:26.985364 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7ec98055-39e5-4932-9e9b-ad82f5508a81 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:26.996954 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aadead1-b606-4be6-9f6f-5dffd533fa34 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=733e4327-f968-4719-912a-193e7da5cf4b,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:27.000497 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-1aadead1-b606-4be6-9f6f-5dffd533fa34 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:27.003917 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1aadead1-b606-4be6-9f6f-5dffd533fa34 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:27.005578 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-1aadead1-b606-4be6-9f6f-5dffd533fa34 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/733e4327-f968-4719-912a-193e7da5cf4b HTTP/1.1" status: 204  len: 168 time: 0.2459800
Jun 01 10:14:27.602206 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 38316) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:27.620429 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cd06776b-69f3-4b2b-9796-3f4b13a37b3b admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:27.635207 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-cd06776b-69f3-4b2b-9796-3f4b13a37b3b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:14:27.639064 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-cd06776b-69f3-4b2b-9796-3f4b13a37b3b admin admin] Usage tracker for resource:security_group_rule and tenant:12675e97a9dc40459c7486108cbd1e65 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:14:27.642582 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-cd06776b-69f3-4b2b-9796-3f4b13a37b3b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:14:27.648323 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-cd06776b-69f3-4b2b-9796-3f4b13a37b3b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:14:27.739186 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cd06776b-69f3-4b2b-9796-3f4b13a37b3b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:27.815713 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cd06776b-69f3-4b2b-9796-3f4b13a37b3b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:27.823241 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-64f3ed42-a380-48ee-8550-29248a1b1c50 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:27.867370 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-cd06776b-69f3-4b2b-9796-3f4b13a37b3b admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=12675e97a9dc40459c7486108cbd1e65&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2617545
Jun 01 10:14:27.867370 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd06776b-69f3-4b2b-9796-3f4b13a37b3b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b45c3c1-1b6b-4514-b0e9-9e3d153c7f5b,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:27.869164 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 38328) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:27.869642 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-cd06776b-69f3-4b2b-9796-3f4b13a37b3b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:27.931934 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:27.960788 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:28.124783 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:28.128507 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-73fea1ce-23c5-4970-b38a-26e466afcc83 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:28.139042 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b45c3c1-1b6b-4514-b0e9-9e3d153c7f5b,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:28.148599 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:28.148960 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:28.149314 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:28.149663 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:28.150007 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:28.150352 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:28.150715 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:28.151079 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:28.151419 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:28.151755 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:28.152091 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:28.152424 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:14:28.156208 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:28.157293 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:28.164668 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-3336fb96-f395-44ad-ba98-daf4a340d5fa admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/2b45c3c1-1b6b-4514-b0e9-9e3d153c7f5b HTTP/1.1" status: 204  len: 168 time: 0.2872152
Jun 01 10:14:40.505554 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-15f1ff7b-4df8-4f83-98d1-c435ecba609c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:42.964024 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-d40b7f0a-9c5b-4a43-8ee7-21ae186cbd4b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:42.989296 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 38576) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:43.115925 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-735d257f-9a61-46d3-b5e9-6dd1acef625f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:43.129699 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-735d257f-9a61-46d3-b5e9-6dd1acef625f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:14:43.133422 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-735d257f-9a61-46d3-b5e9-6dd1acef625f admin admin] Usage tracker for resource:security_group_rule and tenant:25c239e1dce543e1923eb0a46adbc158 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:14:43.136165 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-735d257f-9a61-46d3-b5e9-6dd1acef625f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:14:43.142246 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-735d257f-9a61-46d3-b5e9-6dd1acef625f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:14:43.242932 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-735d257f-9a61-46d3-b5e9-6dd1acef625f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:43.261640 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:43.341735 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-735d257f-9a61-46d3-b5e9-6dd1acef625f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:43.350744 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-77947ddd-73de-4d9f-8af4-c274ee4478f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:43.393511 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-735d257f-9a61-46d3-b5e9-6dd1acef625f admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=25c239e1dce543e1923eb0a46adbc158&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4031408
Jun 01 10:14:43.395139 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-735d257f-9a61-46d3-b5e9-6dd1acef625f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=75afad33-de6a-4626-bd6d-998f30112632,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:43.396227 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 38588) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:43.398612 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-735d257f-9a61-46d3-b5e9-6dd1acef625f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:43.460326 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-69c72d96-fbee-4a3a-9d98-8536b1b67988 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:43.488057 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-69c72d96-fbee-4a3a-9d98-8536b1b67988 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:43.598707 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-69c72d96-fbee-4a3a-9d98-8536b1b67988 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:43.602321 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a40096c8-d226-455f-8831-abc135d696d4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:43.615234 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69c72d96-fbee-4a3a-9d98-8536b1b67988 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=75afad33-de6a-4626-bd6d-998f30112632,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:43.619457 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-69c72d96-fbee-4a3a-9d98-8536b1b67988 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:43.622778 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-69c72d96-fbee-4a3a-9d98-8536b1b67988 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:43.623930 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-69c72d96-fbee-4a3a-9d98-8536b1b67988 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/75afad33-de6a-4626-bd6d-998f30112632 HTTP/1.1" status: 204  len: 168 time: 0.2265761
Jun 01 10:14:44.066762 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:44.310614 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 38600) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:44.328164 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b5b34e78-d0b8-466f-ae85-78af5b668b9f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:44.346696 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-b5b34e78-d0b8-466f-ae85-78af5b668b9f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:14:44.350512 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-b5b34e78-d0b8-466f-ae85-78af5b668b9f admin admin] Usage tracker for resource:security_group_rule and tenant:0f1824878a66417da83e755f4b78e815 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:14:44.353403 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-b5b34e78-d0b8-466f-ae85-78af5b668b9f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:14:44.361010 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-b5b34e78-d0b8-466f-ae85-78af5b668b9f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:14:44.441883 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b5b34e78-d0b8-466f-ae85-78af5b668b9f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:44.512603 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b5b34e78-d0b8-466f-ae85-78af5b668b9f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:44.521959 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-27c43c7c-bc13-497b-af5b-3acdafd7d463 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:44.561874 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-b5b34e78-d0b8-466f-ae85-78af5b668b9f admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=0f1824878a66417da83e755f4b78e815&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2499640
Jun 01 10:14:44.562759 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5b34e78-d0b8-466f-ae85-78af5b668b9f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d3e6496f-d2db-4788-aa85-9b8dd3c60b45,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:44.564639 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 38606) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:44.565797 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b5b34e78-d0b8-466f-ae85-78af5b668b9f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:44.627779 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-31528acc-82be-4c62-aaa6-c7a395364123 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:44.653330 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-31528acc-82be-4c62-aaa6-c7a395364123 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:44.775902 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-31528acc-82be-4c62-aaa6-c7a395364123 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:44.779773 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-418c006a-6d83-464c-bcaf-34fdcc12a72f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:44.793938 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31528acc-82be-4c62-aaa6-c7a395364123 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d3e6496f-d2db-4788-aa85-9b8dd3c60b45,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:44.796854 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-31528acc-82be-4c62-aaa6-c7a395364123 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:44.806031 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-31528acc-82be-4c62-aaa6-c7a395364123 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:44.807191 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-31528acc-82be-4c62-aaa6-c7a395364123 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/d3e6496f-d2db-4788-aa85-9b8dd3c60b45 HTTP/1.1" status: 204  len: 168 time: 0.2415407
Jun 01 10:14:45.516429 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 38616) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:45.537860 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7815adec-0ffb-4901-ac7f-98905a63ba17 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:45.553761 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-7815adec-0ffb-4901-ac7f-98905a63ba17 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:14:45.558151 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-7815adec-0ffb-4901-ac7f-98905a63ba17 admin admin] Usage tracker for resource:security_group_rule and tenant:a9648c20949f4457b0cd799a501f37e2 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:14:45.561056 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-7815adec-0ffb-4901-ac7f-98905a63ba17 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:14:45.566763 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-7815adec-0ffb-4901-ac7f-98905a63ba17 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:14:45.650155 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7815adec-0ffb-4901-ac7f-98905a63ba17 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:45.745657 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7815adec-0ffb-4901-ac7f-98905a63ba17 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:45.754598 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-2c18e0d7-9d4f-4332-8283-c5b71159ce4d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:45.795522 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-7815adec-0ffb-4901-ac7f-98905a63ba17 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=a9648c20949f4457b0cd799a501f37e2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2779541
Jun 01 10:14:45.796493 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7815adec-0ffb-4901-ac7f-98905a63ba17 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d30fa5b6-90f7-4bf7-866d-21b39596796b,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:45.798234 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 38628) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:14:45.799758 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7815adec-0ffb-4901-ac7f-98905a63ba17 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:45.849760 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:45.859671 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-27121043-0347-4ac4-ab7a-8d71ba73afbf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:45.886606 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-27121043-0347-4ac4-ab7a-8d71ba73afbf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:46.015560 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-27121043-0347-4ac4-ab7a-8d71ba73afbf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:46.020041 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-2d8a00f4-6630-48b4-bf27-b8cdad5baf46 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:14:46.036399 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27121043-0347-4ac4-ab7a-8d71ba73afbf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d30fa5b6-90f7-4bf7-866d-21b39596796b,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:14:46.039190 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-27121043-0347-4ac4-ab7a-8d71ba73afbf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:14:46.047570 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-27121043-0347-4ac4-ab7a-8d71ba73afbf admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:14:46.048681 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-27121043-0347-4ac4-ab7a-8d71ba73afbf admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/d30fa5b6-90f7-4bf7-866d-21b39596796b HTTP/1.1" status: 204  len: 168 time: 0.2486665
Jun 01 10:14:54.467484 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:14:56.592524 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:02.913868 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 38824) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:03.031443 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7158d812-51ce-459e-aa12-940981ec161f admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:03.045791 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-7158d812-51ce-459e-aa12-940981ec161f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:03.049637 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-7158d812-51ce-459e-aa12-940981ec161f admin admin] Usage tracker for resource:security_group_rule and tenant:4da1ca89e0fa424b8687fd0d92d086b5 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:03.053130 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-7158d812-51ce-459e-aa12-940981ec161f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:03.058886 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-7158d812-51ce-459e-aa12-940981ec161f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:03.146551 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7158d812-51ce-459e-aa12-940981ec161f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:03.209882 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7158d812-51ce-459e-aa12-940981ec161f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:03.216556 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:03.256972 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7158d812-51ce-459e-aa12-940981ec161f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=488e7e33-d549-46d3-a4cd-ec7cff2a2000,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:03.261167 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-7158d812-51ce-459e-aa12-940981ec161f admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=4da1ca89e0fa424b8687fd0d92d086b5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3462958
Jun 01 10:15:03.262121 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7158d812-51ce-459e-aa12-940981ec161f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:03.263836 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 38838) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:03.322632 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c911c191-ef01-4506-adc5-0c3fc2f3cfd0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:03.347491 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c911c191-ef01-4506-adc5-0c3fc2f3cfd0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:03.587169 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c911c191-ef01-4506-adc5-0c3fc2f3cfd0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:03.592043 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-daa0481e-0fd0-462e-be6d-a9e9130c6abc tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:03.608919 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c911c191-ef01-4506-adc5-0c3fc2f3cfd0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=488e7e33-d549-46d3-a4cd-ec7cff2a2000,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:03.611722 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-c911c191-ef01-4506-adc5-0c3fc2f3cfd0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:03.612654 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c911c191-ef01-4506-adc5-0c3fc2f3cfd0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:03.615126 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-c911c191-ef01-4506-adc5-0c3fc2f3cfd0 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/488e7e33-d549-46d3-a4cd-ec7cff2a2000 HTTP/1.1" status: 204  len: 168 time: 0.3490264
Jun 01 10:15:04.168616 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 38848) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:04.185730 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-bbc70288-5e20-4a02-8ba1-f9bdf0b5997d admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:04.200319 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-bbc70288-5e20-4a02-8ba1-f9bdf0b5997d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:04.204097 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-bbc70288-5e20-4a02-8ba1-f9bdf0b5997d admin admin] Usage tracker for resource:security_group_rule and tenant:ba5745d8a57e4b94b417419e78bc74b5 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:04.206847 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-bbc70288-5e20-4a02-8ba1-f9bdf0b5997d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:04.213408 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-bbc70288-5e20-4a02-8ba1-f9bdf0b5997d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:04.292090 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-bbc70288-5e20-4a02-8ba1-f9bdf0b5997d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:04.358225 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-bbc70288-5e20-4a02-8ba1-f9bdf0b5997d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:04.365497 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-27121043-0347-4ac4-ab7a-8d71ba73afbf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:04.404273 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbc70288-5e20-4a02-8ba1-f9bdf0b5997d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eca9d43f-8d76-4301-9ecb-bf0e67b7d478,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:04.408543 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-bbc70288-5e20-4a02-8ba1-f9bdf0b5997d admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=ba5745d8a57e4b94b417419e78bc74b5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2390094
Jun 01 10:15:04.409402 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-bbc70288-5e20-4a02-8ba1-f9bdf0b5997d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:04.411705 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 38852) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:04.467501 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2ff6b508-ddd3-4f65-af1c-6bccaec4fbdf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:04.496767 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2ff6b508-ddd3-4f65-af1c-6bccaec4fbdf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:04.619758 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2ff6b508-ddd3-4f65-af1c-6bccaec4fbdf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:04.623594 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-4604f5e9-f66c-4d35-89c4-7aa4dd5bc8ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:04.635192 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ff6b508-ddd3-4f65-af1c-6bccaec4fbdf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eca9d43f-8d76-4301-9ecb-bf0e67b7d478,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:04.639068 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-2ff6b508-ddd3-4f65-af1c-6bccaec4fbdf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:04.642460 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2ff6b508-ddd3-4f65-af1c-6bccaec4fbdf admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:04.643701 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-2ff6b508-ddd3-4f65-af1c-6bccaec4fbdf admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/eca9d43f-8d76-4301-9ecb-bf0e67b7d478 HTTP/1.1" status: 204  len: 168 time: 0.2316675
Jun 01 10:15:05.859186 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ad3900f2-47a0-4686-9430-a19b3120ad4b req-e911bc32-7dad-41f5-8ef8-f420a848c985 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2000309515&fields=id&tenant_id=42ccd1aa89a94252b32a254cead654ef HTTP/1.1" status: 200  len: 267 time: 0.0409441
Jun 01 10:15:05.943211 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad3900f2-47a0-4686-9430-a19b3120ad4b req-8d454d47-d4b5-4400-89b7-5645a5c2d2d2 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:05.945184 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ad3900f2-47a0-4686-9430-a19b3120ad4b req-8d454d47-d4b5-4400-89b7-5645a5c2d2d2 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 985 time: 0.0800345
Jun 01 10:15:05.955423 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-ad3900f2-47a0-4686-9430-a19b3120ad4b req-214c6cb4-1462-43cf-9fa6-b3d3c0cdceb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Request body: {'port': {'security_groups': ['4c6403a1-41d1-46bb-a1d5-56a5a21fff27']}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:15:06.076628 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-ad3900f2-47a0-4686-9430-a19b3120ad4b req-214c6cb4-1462-43cf-9fa6-b3d3c0cdceb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:06.324896 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-ad3900f2-47a0-4686-9430-a19b3120ad4b req-214c6cb4-1462-43cf-9fa6-b3d3c0cdceb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] For port 14a54ac6-61b8-43e2-b571-8a9993ebd80c, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=14a54ac6-61b8-43e2-b571-8a9993ebd80c,segment=NetworkSegment(4888209f-5226-40f1-b206-246370701bbd),segment_id=4888209f-5226-40f1-b206-246370701bbd)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:06.350114 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-ad3900f2-47a0-4686-9430-a19b3120ad4b req-214c6cb4-1462-43cf-9fa6-b3d3c0cdceb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:06.421300 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-ad3900f2-47a0-4686-9430-a19b3120ad4b req-214c6cb4-1462-43cf-9fa6-b3d3c0cdceb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:06.427920 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-58040a77-530d-404a-9257-4a049baa876c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:06.492702 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad3900f2-47a0-4686-9430-a19b3120ad4b req-214c6cb4-1462-43cf-9fa6-b3d3c0cdceb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:06.493321 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-ad3900f2-47a0-4686-9430-a19b3120ad4b req-214c6cb4-1462-43cf-9fa6-b3d3c0cdceb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:06.494721 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ad3900f2-47a0-4686-9430-a19b3120ad4b req-214c6cb4-1462-43cf-9fa6-b3d3c0cdceb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "PUT /v2.0/ports/14a54ac6-61b8-43e2-b571-8a9993ebd80c HTTP/1.1" status: 200  len: 943 time: 0.5438857
Jun 01 10:15:06.495255 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'tag': '14a54ac6-61b8-43e2-b571-8a9993ebd80c'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:15:06.497531 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b28a2bfe-e83b-40e3-9fba-62872fef6742" -d '{"events": [{"name": "network-changed", "server_uuid": "c52836ef-4dc8-4dd2-a679-e9d0cbeaa489", "tag": "14a54ac6-61b8-43e2-b571-8a9993ebd80c"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:15:06.500574 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 38888) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:06.516525 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-214c6cb4-1462-43cf-9fa6-b3d3c0cdceb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Pushing event updated for resources: {'Port': ['ID=14a54ac6-61b8-43e2-b571-8a9993ebd80c,revision_number=7']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:06.523946 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-214c6cb4-1462-43cf-9fa6-b3d3c0cdceb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:06.553722 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:15:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-24b10753-195c-4187-8f59-24d8f4c50df1 x-openstack-request-id: req-24b10753-195c-4187-8f59-24d8f4c50df1 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:15:06.554095 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c52836ef-4dc8-4dd2-a679-e9d0cbeaa489", "tag": "14a54ac6-61b8-43e2-b571-8a9993ebd80c", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:15:06.554334 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-24b10753-195c-4187-8f59-24d8f4c50df1 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:15:06.554964 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'tag': '14a54ac6-61b8-43e2-b571-8a9993ebd80c', 'status': 'completed', 'code': 200}
Jun 01 10:15:06.588419 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b4eb3492-5324-4390-af52-b557f296e144 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:06.622746 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b4eb3492-5324-4390-af52-b557f296e144 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:06.686188 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['14a54ac6-61b8-43e2-b571-8a9993ebd80c'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:15:06.772263 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-279ba32d-1c9f-4dca-88b3-c7303fe53822 None None] Provisioning complete for port 14a54ac6-61b8-43e2-b571-8a9993ebd80c triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:06.772641 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-279ba32d-1c9f-4dca-88b3-c7303fe53822 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:06.788037 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b28a2bfe-e83b-40e3-9fba-62872fef6742 req-ef99c292-c9c3-4b04-9802-6bb8cc716d67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:06.790432 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b28a2bfe-e83b-40e3-9fba-62872fef6742 req-ef99c292-c9c3-4b04-9802-6bb8cc716d67 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=42ccd1aa89a94252b32a254cead654ef&device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 1099 time: 0.0843694
Jun 01 10:15:06.802927 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['14a54ac6-61b8-43e2-b571-8a9993ebd80c'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:15:06.870586 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b4eb3492-5324-4390-af52-b557f296e144 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:06.880034 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-caaa64b6-5fa6-458f-b1c8-acfae40e3edd tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:06.904965 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4eb3492-5324-4390-af52-b557f296e144 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=84f2a1e4-cc30-4691-8e14-0c27546b9656,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:06.907943 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b4eb3492-5324-4390-af52-b557f296e144 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:06.952763 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b28a2bfe-e83b-40e3-9fba-62872fef6742 req-243f12cd-e530-4100-8173-d352d9a1d5ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:06.954324 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b28a2bfe-e83b-40e3-9fba-62872fef6742 req-243f12cd-e530-4100-8173-d352d9a1d5ca service neutron] 10.222.0.30 "GET /v2.0/networks?id=d11181a0-389a-4fe3-b44f-805e01bb81e5 HTTP/1.1" status: 200  len: 916 time: 0.1569283
Jun 01 10:15:07.042541 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b4eb3492-5324-4390-af52-b557f296e144 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:07.046119 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-b4eb3492-5324-4390-af52-b557f296e144 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "DELETE /v2.0/security-groups/84f2a1e4-cc30-4691-8e14-0c27546b9656 HTTP/1.1" status: 204  len: 168 time: 0.5419459
Jun 01 10:15:07.046525 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 38898) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:07.069795 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b28a2bfe-e83b-40e3-9fba-62872fef6742 req-bedee6af-1784-43c9-a4e2-d4483137fa62 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=14a54ac6-61b8-43e2-b571-8a9993ebd80c HTTP/1.1" status: 200  len: 1002 time: 0.1078763
Jun 01 10:15:07.136139 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b28a2bfe-e83b-40e3-9fba-62872fef6742 req-870eb3ba-78e7-421c-a9ae-9a6fcf0c55de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:07.137593 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b28a2bfe-e83b-40e3-9fba-62872fef6742 req-870eb3ba-78e7-421c-a9ae-9a6fcf0c55de service neutron] 10.222.0.30 "GET /v2.0/subnets?id=dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9 HTTP/1.1" status: 200  len: 854 time: 0.0605412
Jun 01 10:15:07.229189 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b28a2bfe-e83b-40e3-9fba-62872fef6742 req-3a5eb2f0-f939-455d-94b7-a0e306a30699 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:07.230700 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b28a2bfe-e83b-40e3-9fba-62872fef6742 req-3a5eb2f0-f939-455d-94b7-a0e306a30699 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=d11181a0-389a-4fe3-b44f-805e01bb81e5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0863955
Jun 01 10:15:07.336763 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-c4609343-7166-4f77-99e6-70595adba19f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Deleting port b18e200f-e82e-49f0-92cd-b2dbcc493bb8 {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:15:07.337101 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c4609343-7166-4f77-99e6-70595adba19f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:07.367196 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b28a2bfe-e83b-40e3-9fba-62872fef6742 req-aecd1d9b-23f1-4cf2-9d98-a08a9595e058 service neutron] 10.222.0.30 "GET /v2.0/networks/d11181a0-389a-4fe3-b44f-805e01bb81e5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1292949
Jun 01 10:15:07.455510 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c4609343-7166-4f77-99e6-70595adba19f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:07.455843 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c4609343-7166-4f77-99e6-70595adba19f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:07.593247 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-c4609343-7166-4f77-99e6-70595adba19f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Calling delete_port for b18e200f-e82e-49f0-92cd-b2dbcc493bb8 owned by network:floatingip {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:15:07.598330 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b28a2bfe-e83b-40e3-9fba-62872fef6742 req-52580615-3435-45d7-9b4e-91d5e40e95ec service neutron] 10.222.0.30 "GET /v2.0/networks/d11181a0-389a-4fe3-b44f-805e01bb81e5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2244873
Jun 01 10:15:07.804198 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c4609343-7166-4f77-99e6-70595adba19f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:07.810145 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-442eb385-d89b-459e-921c-a05311c7a639 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:07.860881 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4609343-7166-4f77-99e6-70595adba19f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Pushing event deleted for resources: {'Port': ['ID=b18e200f-e82e-49f0-92cd-b2dbcc493bb8,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:07.895279 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-c4609343-7166-4f77-99e6-70595adba19f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:07.966931 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-75fb46ea-c41e-46d6-a345-3e6d290a6b8a tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/networks?tenant_id=dd194530ace647528541aa8b14f12136&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0630183
Jun 01 10:15:08.131549 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c4609343-7166-4f77-99e6-70595adba19f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks [] for floatingip, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:08.132242 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.l3_db [None req-c4609343-7166-4f77-99e6-70595adba19f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Floating IP a04efc96-43e4-4391-b0d0-21d65c616a25 disassociated (deleted). External IP: 172.27.2.241, port: 14a54ac6-61b8-43e2-b571-8a9993ebd80c.
Jun 01 10:15:08.352385 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-0cf2779c-633b-486c-9fd1-aabdbfe7099c tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:08.353828 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-0cf2779c-633b-486c-9fd1-aabdbfe7099c tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.3797953
Jun 01 10:15:08.377999 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-10568205-f685-45f8-b638-61ab3244cb3e tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/quotas/dd194530ace647528541aa8b14f12136 HTTP/1.1" status: 200  len: 375 time: 0.0160995
Jun 01 10:15:08.498673 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-6f1f629e-9857-4727-b4d4-7a7876b774e4 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=dd194530ace647528541aa8b14f12136&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0619504
Jun 01 10:15:08.598144 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c4609343-7166-4f77-99e6-70595adba19f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Router d44c71f4-9c5a-4af0-9ac9-0a309921c707 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92566) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:15:08.780662 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c4609343-7166-4f77-99e6-70595adba19f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:15:08.797400 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c4609343-7166-4f77-99e6-70595adba19f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:08.805245 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f53e666-2a5a-400b-9f45-0d4c924239e1 None None] Sync routers for ids ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:15:08.827135 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f53e666-2a5a-400b-9f45-0d4c924239e1 None None] Routers {'d44c71f4-9c5a-4af0-9ac9-0a309921c707'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:15:08.827769 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-7f53e666-2a5a-400b-9f45-0d4c924239e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe71b76130>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:14:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:08.896946 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-548973af-c83d-411a-8f4c-0e354ed2ee7c req-7eef0fdd-f189-4592-8f6e-92cc9d3ae026 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/ports?device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 210 time: 0.0610354
Jun 01 10:15:08.908853 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-c4609343-7166-4f77-99e6-70595adba19f tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "DELETE /v2.0/floatingips/a04efc96-43e4-4391-b0d0-21d65c616a25 HTTP/1.1" status: 204  len: 168 time: 1.8612070
Jun 01 10:15:08.909861 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'tag': '14a54ac6-61b8-43e2-b571-8a9993ebd80c'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:15:08.921437 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b0e9adf7-d374-4df0-ab11-c6d086e4d5c9" -d '{"events": [{"name": "network-changed", "server_uuid": "c52836ef-4dc8-4dd2-a679-e9d0cbeaa489", "tag": "14a54ac6-61b8-43e2-b571-8a9993ebd80c"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:15:08.975324 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:15:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b911ebe6-5613-41d2-a5f5-c20fa37fdeb4 x-openstack-request-id: req-b911ebe6-5613-41d2-a5f5-c20fa37fdeb4 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:15:08.975654 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c52836ef-4dc8-4dd2-a679-e9d0cbeaa489", "tag": "14a54ac6-61b8-43e2-b571-8a9993ebd80c", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:15:08.975940 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-b911ebe6-5613-41d2-a5f5-c20fa37fdeb4 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:15:08.976372 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'tag': '14a54ac6-61b8-43e2-b571-8a9993ebd80c', 'status': 'completed', 'code': 200}
Jun 01 10:15:09.043015 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-7f53e666-2a5a-400b-9f45-0d4c924239e1 None None] Set router d44c71f4-9c5a-4af0-9ac9-0a309921c707 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:15:09.086186 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e9adf7-d374-4df0-ab11-c6d086e4d5c9 req-caa791e9-b51c-4442-ad54-793e9471b27f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:09.088532 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b0e9adf7-d374-4df0-ab11-c6d086e4d5c9 req-caa791e9-b51c-4442-ad54-793e9471b27f service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=42ccd1aa89a94252b32a254cead654ef&device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 1099 time: 0.0813093
Jun 01 10:15:09.236314 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e9adf7-d374-4df0-ab11-c6d086e4d5c9 req-bb76dbfd-b871-462c-9174-443656381ecf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:09.237807 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b0e9adf7-d374-4df0-ab11-c6d086e4d5c9 req-bb76dbfd-b871-462c-9174-443656381ecf service neutron] 10.222.0.30 "GET /v2.0/networks?id=d11181a0-389a-4fe3-b44f-805e01bb81e5 HTTP/1.1" status: 200  len: 916 time: 0.1398256
Jun 01 10:15:09.321416 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b0e9adf7-d374-4df0-ab11-c6d086e4d5c9 req-65b604c8-64fd-446a-bea7-dd002bc89fbe service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=14a54ac6-61b8-43e2-b571-8a9993ebd80c HTTP/1.1" status: 200  len: 217 time: 0.0653727
Jun 01 10:15:09.382264 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-7f53e666-2a5a-400b-9f45-0d4c924239e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe71b76130>, [{'id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'name': 'tempest-TestMinimumBasicScenario-1893805309-router', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221'}], 'enable_snat': True}, 'gw_port_id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:20Z', 'updated_at': '2021-06-01T10:12:25Z', 'revision_number': 4, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'gw_port': {'id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:01:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:21Z', 'updated_at': '2021-06-01T10:12:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '0c15f869-9e44-4931-a089-e90025a105a3', 'name': '', 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'mac_address': 'fa:16:3e:7a:de:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_interface', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:24Z', 'updated_at': '2021-06-01T10:12:34Z', 'revision_number': 5, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'subnets': [{'id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:09.385817 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e9adf7-d374-4df0-ab11-c6d086e4d5c9 req-51c94287-d726-4d58-adb7-dfa350d539b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:09.386813 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f53e666-2a5a-400b-9f45-0d4c924239e1 None None] Checking router: d44c71f4-9c5a-4af0-9ac9-0a309921c707 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:15:09.387335 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b0e9adf7-d374-4df0-ab11-c6d086e4d5c9 req-51c94287-d726-4d58-adb7-dfa350d539b8 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9 HTTP/1.1" status: 200  len: 854 time: 0.0643728
Jun 01 10:15:09.395508 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f53e666-2a5a-400b-9f45-0d4c924239e1 None None] Routers {'d44c71f4-9c5a-4af0-9ac9-0a309921c707'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:15:09.396108 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-7f53e666-2a5a-400b-9f45-0d4c924239e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe71b76130>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:14:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:09.495056 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e9adf7-d374-4df0-ab11-c6d086e4d5c9 req-61871a98-6e54-46d0-9cda-d400973e31fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:09.497817 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b0e9adf7-d374-4df0-ab11-c6d086e4d5c9 req-61871a98-6e54-46d0-9cda-d400973e31fa service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=d11181a0-389a-4fe3-b44f-805e01bb81e5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1005445
Jun 01 10:15:09.617434 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-7f53e666-2a5a-400b-9f45-0d4c924239e1 None None] Set router d44c71f4-9c5a-4af0-9ac9-0a309921c707 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:15:09.644825 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b0e9adf7-d374-4df0-ab11-c6d086e4d5c9 req-80b96869-cfa4-41b8-8031-30a27b862f83 service neutron] 10.222.0.30 "GET /v2.0/networks/d11181a0-389a-4fe3-b44f-805e01bb81e5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1371355
Jun 01 10:15:09.792715 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-b0e9adf7-d374-4df0-ab11-c6d086e4d5c9 req-43ea8224-85fc-49ba-ad19-baafd09e2f02 service neutron] 10.222.0.30 "GET /v2.0/networks/d11181a0-389a-4fe3-b44f-805e01bb81e5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1365378
Jun 01 10:15:09.955642 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-7f53e666-2a5a-400b-9f45-0d4c924239e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe71b76130>, [{'id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'name': 'tempest-TestMinimumBasicScenario-1893805309-router', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221'}], 'enable_snat': True}, 'gw_port_id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:20Z', 'updated_at': '2021-06-01T10:12:25Z', 'revision_number': 4, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'gw_port': {'id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:01:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:21Z', 'updated_at': '2021-06-01T10:12:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '0c15f869-9e44-4931-a089-e90025a105a3', 'name': '', 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'mac_address': 'fa:16:3e:7a:de:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_interface', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:24Z', 'updated_at': '2021-06-01T10:12:34Z', 'revision_number': 5, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'subnets': [{'id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:09.960266 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f53e666-2a5a-400b-9f45-0d4c924239e1 None None] The sync data for ids ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'] in dv-cinder-787262-4-iscsi is: [{'id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'name': 'tempest-TestMinimumBasicScenario-1893805309-router', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221'}], 'enable_snat': True}, 'gw_port_id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:20Z', 'updated_at': '2021-06-01T10:12:25Z', 'revision_number': 4, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'gw_port': {'id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:01:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:21Z', 'updated_at': '2021-06-01T10:12:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '0c15f869-9e44-4931-a089-e90025a105a3', 'name': '', 'network_id': 'd11181a0-389a-4fe3-b44f-805e01bb81e5', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'mac_address': 'fa:16:3e:7a:de:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_interface', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:24Z', 'updated_at': '2021-06-01T10:12:34Z', 'revision_number': 5, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'subnets': [{'id': 'dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:15:10.001161 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-19d34ac1-5cca-4523-8d2d-c6932644a916 req-4252dc4d-3619-461d-bf7d-8ba9c0f0f5ec tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/ports?device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 210 time: 0.0470448
Jun 01 10:15:10.183988 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acad2925-8453-4fc9-a70a-eeabd1c14295 None None] New status for floating IP a04efc96-43e4-4391-b0d0-21d65c616a25: DOWN {{(pid=92568) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:15:10.501226 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-ce715b2c-cc5b-4bad-a329-cc8ffa7b1ca6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:11.150327 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-791eb91d-9938-42c0-9ab8-66e5145614fa req-e14201b3-f8c5-4ef5-a064-4abd7bda970a tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/ports?device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 210 time: 0.0442648
Jun 01 10:15:12.309455 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0ff8b351-f802-4877-b895-2f845325e392 req-7946f209-54a2-4824-a7f6-7c05c53a1321 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/ports?device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 210 time: 0.0511658
Jun 01 10:15:12.328259 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-e501ac8d-0749-4666-95d7-e9f5d4346bdd tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.30 "GET /v2.0/networks?tenant_id=dd194530ace647528541aa8b14f12136&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0456674
Jun 01 10:15:12.490660 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-4e460ab5-b3d5-4a7d-b065-d13ca700e98a tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:12.492147 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-4e460ab5-b3d5-4a7d-b065-d13ca700e98a tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1579666
Jun 01 10:15:12.504529 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Request body: {'port': {'device_id': 'bffa2858-4e7e-4a0f-934d-c543b02c90d4', 'network_id': 'c0c2a0bb-c319-4af9-971a-32b17b1a0361', 'admin_state_up': True, 'tenant_id': 'dd194530ace647528541aa8b14f12136'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:15:12.519781 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39032) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:12.635736 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a894fb41-ca2f-4cf8-b5c3-3380e90775e4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:12.647792 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:12.650607 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-a894fb41-ca2f-4cf8-b5c3-3380e90775e4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:12.651989 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Usage tracker for resource:port and tenant:dd194530ace647528541aa8b14f12136 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:12.654374 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-a894fb41-ca2f-4cf8-b5c3-3380e90775e4 admin admin] Usage tracker for resource:security_group_rule and tenant:000e113370da440db35b3f7a05b14b21 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:12.654812 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Quota usage for port was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:12.657224 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-a894fb41-ca2f-4cf8-b5c3-3380e90775e4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:12.661383 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:12.663548 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-a894fb41-ca2f-4cf8-b5c3-3380e90775e4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:12.747036 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a894fb41-ca2f-4cf8-b5c3-3380e90775e4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:12.781295 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Made reservation on behalf of dd194530ace647528541aa8b14f12136 for: {'port': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:15:12.784873 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:12.798547 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:12.813261 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:12.817212 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Usage tracker for resource:security_group_rule and tenant:dd194530ace647528541aa8b14f12136 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:12.819848 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:12.825552 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:12.856793 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a894fb41-ca2f-4cf8-b5c3-3380e90775e4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:12.872096 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-10d002f1-84e5-4443-b0de-ab9f4e4e4fb2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:12.938190 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:12.940903 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-a894fb41-ca2f-4cf8-b5c3-3380e90775e4 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=000e113370da440db35b3f7a05b14b21&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4275849
Jun 01 10:15:12.941911 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a894fb41-ca2f-4cf8-b5c3-3380e90775e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f57c1aa-13f6-4d65-9efb-4891c0c22aa5,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:12.943524 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39040) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:12.946117 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a894fb41-ca2f-4cf8-b5c3-3380e90775e4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:12.998274 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-693e1f2d-6875-4e9a-978b-6551374e87df None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:13.014339 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cbb0db27-7e63-4ba6-84de-2e4f50eb3c8d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:13.040365 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cbb0db27-7e63-4ba6-84de-2e4f50eb3c8d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:13.077330 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:13.081884 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-63889874-287f-4d1f-8968-c9b446deeb46 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:13.143055 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Pushing event updated for resources: {'SecurityGroup': ['ID=01693162-beb1-44c0-8458-46b1f7d34834,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:13.146798 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:13.248332 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cbb0db27-7e63-4ba6-84de-2e4f50eb3c8d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:13.261718 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-29d52c68-9e57-4146-9d66-1c44e46ac4a0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:13.278240 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:13.286974 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbb0db27-7e63-4ba6-84de-2e4f50eb3c8d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f57c1aa-13f6-4d65-9efb-4891c0c22aa5,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:13.293569 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-cbb0db27-7e63-4ba6-84de-2e4f50eb3c8d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:13.341727 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cbb0db27-7e63-4ba6-84de-2e4f50eb3c8d admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:13.342886 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-cbb0db27-7e63-4ba6-84de-2e4f50eb3c8d admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/9f57c1aa-13f6-4d65-9efb-4891c0c22aa5 HTTP/1.1" status: 204  len: 168 time: 0.3973300
Jun 01 10:15:13.382476 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Allocated IP 192.168.233.74 (c0c2a0bb-c319-4af9-971a-32b17b1a0361/085f1fc7-30e6-43bf-8c84-be1266ce2fda/dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:15:13.472074 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-10c7429b-03a8-4f7a-b727-0263d1b212d9 req-7d224665-ee19-4ec3-af1a-d963e42f70fc tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/ports?device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 210 time: 0.0481133
Jun 01 10:15:13.596259 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:13.614567 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.provisioning_blocks [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Transition to ACTIVE for port object dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa will not be triggered until provisioned by entity DHCP. {{(pid=92565) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:15:13.688831 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:13.696471 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8193c11d-78ac-4d20-96ae-2cf77888dbfb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:13.869505 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Network c0c2a0bb-c319-4af9-971a-32b17b1a0361 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:15:13.873564 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:15:13.877934 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:15:13.917122 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Pushing event updated for resources: {'Port': ['ID=dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:13.922296 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.226s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:13.953557 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:13.962153 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:14.051733 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72625f60-70dd-4a05-9082-1f3387dd37ca req-593fd687-5e41-4207-b6d6-d602399eeab0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:14.052444 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-72625f60-70dd-4a05-9082-1f3387dd37ca req-593fd687-5e41-4207-b6d6-d602399eeab0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Synchronizing usage tracker for tenant:42ccd1aa89a94252b32a254cead654ef on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:15:14.065771 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:14.067013 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39058) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:14.069140 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 937 time: 1.5682273
Jun 01 10:15:14.081105 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Request body: {'port': {'device_id': 'bffa2858-4e7e-4a0f-934d-c543b02c90d4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:15:14.086005 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8b183c8e-ab9b-4f19-885d-62b2796a01c1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:14.101333 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-8b183c8e-ab9b-4f19-885d-62b2796a01c1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:14.104638 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-8b183c8e-ab9b-4f19-885d-62b2796a01c1 admin admin] Usage tracker for resource:security_group_rule and tenant:8531baa44e934adba2973f514029653a is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:14.107442 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-8b183c8e-ab9b-4f19-885d-62b2796a01c1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:14.115575 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-8b183c8e-ab9b-4f19-885d-62b2796a01c1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:14.143461 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-72625f60-70dd-4a05-9082-1f3387dd37ca req-593fd687-5e41-4207-b6d6-d602399eeab0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Unset dirty status for tenant:42ccd1aa89a94252b32a254cead654ef on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:15:14.144627 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-72625f60-70dd-4a05-9082-1f3387dd37ca req-593fd687-5e41-4207-b6d6-d602399eeab0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 946 time: 0.1812086
Jun 01 10:15:14.194970 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:14.198374 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-775ec054-eda1-4863-8d56-7e218d59ade0 None None] Provisioning for port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:15:14.203540 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-775ec054-eda1-4863-8d56-7e218d59ade0 None None] Provisioning complete for port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:14.204310 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-775ec054-eda1-4863-8d56-7e218d59ade0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:14.213400 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-72625f60-70dd-4a05-9082-1f3387dd37ca req-1fe24a0f-9972-4440-8cac-102154255831 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0600450
Jun 01 10:15:14.251754 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8b183c8e-ab9b-4f19-885d-62b2796a01c1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:14.260565 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-775ec054-eda1-4863-8d56-7e218d59ade0 None None] Port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:15:14.358176 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8b183c8e-ab9b-4f19-885d-62b2796a01c1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:14.366493 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7d53ac44-7c87-4386-ad21-ccc526e69e7a tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:14.405572 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-8b183c8e-ab9b-4f19-885d-62b2796a01c1 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=8531baa44e934adba2973f514029653a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3375375
Jun 01 10:15:14.406735 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b183c8e-ab9b-4f19-885d-62b2796a01c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9135ee69-b704-4b0e-9351-25bad57730cf,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:14.409228 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39062) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:14.412211 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-8b183c8e-ab9b-4f19-885d-62b2796a01c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:14.472342 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-85f1bb78-52db-43c9-a710-583514c1651f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:14.498682 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-85f1bb78-52db-43c9-a710-583514c1651f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:14.620287 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-85f1bb78-52db-43c9-a710-583514c1651f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:14.632855 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa {{(pid=92565) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:15:14.640666 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:14.656322 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.provisioning_blocks [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Transition to ACTIVE for port object dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa will not be triggered until provisioned by entity L2. {{(pid=92565) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:15:14.712393 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2295697'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:14.715263 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-bbc70288-5e20-4a02-8ba1-f9bdf0b5997d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:14.718838 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:14.735885 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85f1bb78-52db-43c9-a710-583514c1651f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9135ee69-b704-4b0e-9351-25bad57730cf,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:14.735885 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-85f1bb78-52db-43c9-a710-583514c1651f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:14.749420 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-85f1bb78-52db-43c9-a710-583514c1651f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:14.753706 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-85f1bb78-52db-43c9-a710-583514c1651f admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/9135ee69-b704-4b0e-9351-25bad57730cf HTTP/1.1" status: 204  len: 168 time: 0.3404341
Jun 01 10:15:14.785546 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35f10571-0565-4b59-b7ef-7087b5b1ae1a req-3bb426e6-c89d-449f-a7f6-3f8694094897 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:14.787368 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-35f10571-0565-4b59-b7ef-7087b5b1ae1a req-3bb426e6-c89d-449f-a7f6-3f8694094897 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/ports?device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 935 time: 0.2068157
Jun 01 10:15:14.846881 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-35f10571-0565-4b59-b7ef-7087b5b1ae1a req-5991ef74-7a4b-439e-ac8c-8cc791170305 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/security-groups?id=01693162-beb1-44c0-8458-46b1f7d34834&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0531347
Jun 01 10:15:14.884914 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Pushing event updated for resources: {'Port': ['ID=dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:14.887901 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:14.965245 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Attempting to bind port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:15:14.965715 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Attempting to bind port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': '23fb1f68-b8b8-40f2-b730-865b14c5c5f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'c0c2a0bb-c319-4af9-971a-32b17b1a0361'}] {{(pid=92565) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:15:14.966046 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Attempting to bind port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa on network c0c2a0bb-c319-4af9-971a-32b17b1a0361 {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:15:14.976083 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa on network c0c2a0bb-c319-4af9-971a-32b17b1a0361 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:15:14.976415 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Attempting to bind port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa on network c0c2a0bb-c319-4af9-971a-32b17b1a0361 {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:15:14.982461 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 14, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:15:14.982799 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Checking segment: {'id': '23fb1f68-b8b8-40f2-b730-865b14c5c5f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'c0c2a0bb-c319-4af9-971a-32b17b1a0361'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92565) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:15:14.983307 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Bound using segment: {'id': '23fb1f68-b8b8-40f2-b730-865b14c5c5f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'c0c2a0bb-c319-4af9-971a-32b17b1a0361'} {{(pid=92565) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:15:14.983640 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.managers [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Bound port: dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '23fb1f68-b8b8-40f2-b730-865b14c5c5f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'c0c2a0bb-c319-4af9-971a-32b17b1a0361'}}] {{(pid=92565) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:15:14.983989 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:15.077980 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] For port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa, host hv-cinder-78726, cleared binding levels {{(pid=92565) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:15:15.081502 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] For port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa,segment=NetworkSegment(23fb1f68-b8b8-40f2-b730-865b14c5c5f3),segment_id=23fb1f68-b8b8-40f2-b730-865b14c5c5f3)] {{(pid=92565) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:15:15.164733 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2295697'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:15.169639 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-fd615c5f-2234-4e92-9745-6480eda2d801 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:15.226689 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:15.227420 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:15.228832 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] 10.222.0.30 "PUT /v2.0/ports/dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa HTTP/1.1" status: 200  len: 1097 time: 1.1519051
Jun 01 10:15:15.229362 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bffa2858-4e7e-4a0f-934d-c543b02c90d4', 'tag': 'dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:15:15.231962 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-659d9b18-bda9-44cf-a526-5d6cca36bb8f" -d '{"events": [{"name": "network-changed", "server_uuid": "bffa2858-4e7e-4a0f-934d-c543b02c90d4", "tag": "dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:15:15.255518 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Pushing event updated for resources: {'Port': ['ID=dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa,revision_number=3']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:15.258863 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:15.321781 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:15:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e818c325-5c83-47f8-9b91-96105cc4cc15 x-openstack-request-id: req-e818c325-5c83-47f8-9b91-96105cc4cc15 {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:15:15.322366 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bffa2858-4e7e-4a0f-934d-c543b02c90d4", "tag": "dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:15:15.322667 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-e818c325-5c83-47f8-9b91-96105cc4cc15 {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:15:15.323141 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bffa2858-4e7e-4a0f-934d-c543b02c90d4', 'tag': 'dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa', 'status': 'completed', 'code': 200}
Jun 01 10:15:15.434817 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-659d9b18-bda9-44cf-a526-5d6cca36bb8f req-a4d59b6f-01bd-4b1c-817b-9f4ce87e6502 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:15.441284 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-659d9b18-bda9-44cf-a526-5d6cca36bb8f req-a4d59b6f-01bd-4b1c-817b-9f4ce87e6502 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=dd194530ace647528541aa8b14f12136&device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 1100 time: 0.0910881
Jun 01 10:15:15.453778 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e8ed466-a62d-4e19-9d93-93bc6b10bd8c req-fa88b56e-a889-48b9-b43a-31085c7b2781 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:15.455263 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0e8ed466-a62d-4e19-9d93-93bc6b10bd8c req-fa88b56e-a889-48b9-b43a-31085c7b2781 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 946 time: 0.0949738
Jun 01 10:15:15.469172 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-659d9b18-bda9-44cf-a526-5d6cca36bb8f req-0732042b-1880-4188-b366-7bf715f4e668 service neutron] 10.222.0.30 "GET /v2.0/networks?tenant_id=dd194530ace647528541aa8b14f12136&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0251410
Jun 01 10:15:15.506124 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0e8ed466-a62d-4e19-9d93-93bc6b10bd8c req-47e09d7d-bd9d-43ef-9e4e-cb2555fbccca tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0448170
Jun 01 10:15:15.616829 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-659d9b18-bda9-44cf-a526-5d6cca36bb8f req-380f9402-7115-4fbf-b039-33c95eb2096e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:15.618329 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-659d9b18-bda9-44cf-a526-5d6cca36bb8f req-380f9402-7115-4fbf-b039-33c95eb2096e service neutron] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1422191
Jun 01 10:15:15.728693 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-3202f0f9-4bfc-458c-a30c-ddab56bac3cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:15.728693 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-3202f0f9-4bfc-458c-a30c-ddab56bac3cb service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=dd194530ace647528541aa8b14f12136&device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 1100 time: 0.0719721
Jun 01 10:15:15.802497 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-594d380b-d49b-425a-ac18-2de868586bf1 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.74&port_id=dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa HTTP/1.1" status: 200  len: 217 time: 0.0668321
Jun 01 10:15:15.855676 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:15.876587 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f4830ec0-fc3a-4d59-b533-474dd8e25c35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:15.878054 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-f4830ec0-fc3a-4d59-b533-474dd8e25c35 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=085f1fc7-30e6-43bf-8c84-be1266ce2fda HTTP/1.1" status: 200  len: 843 time: 0.0654359
Jun 01 10:15:15.961998 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-502d6ab4-ce69-48ae-8ef6-5a0224a69d1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:15.963672 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-502d6ab4-ce69-48ae-8ef6-5a0224a69d1c service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=c0c2a0bb-c319-4af9-971a-32b17b1a0361&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.0790048
Jun 01 10:15:16.084613 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19e7ae52-7d32-4eeb-84bf-521e1f1b31f1 req-9e94ffd9-539f-4c0b-9037-a681bbee60b9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:16.086020 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-19e7ae52-7d32-4eeb-84bf-521e1f1b31f1 req-9e94ffd9-539f-4c0b-9037-a681bbee60b9 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.30 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 946 time: 0.1480579
Jun 01 10:15:16.104286 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6da2fc48-8354-4bd8-bca9-3d8dbb427a8c req-f83560e5-d49a-4999-bf10-e33262f157f3 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:16.106012 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6da2fc48-8354-4bd8-bca9-3d8dbb427a8c req-f83560e5-d49a-4999-bf10-e33262f157f3 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/ports?device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 947 time: 0.1345308
Jun 01 10:15:16.221218 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-4ac10a0d-4ef2-4422-854e-f41aea6faa43 service neutron] 10.222.0.30 "GET /v2.0/networks/c0c2a0bb-c319-4af9-971a-32b17b1a0361?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2489083
Jun 01 10:15:16.239634 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6da2fc48-8354-4bd8-bca9-3d8dbb427a8c req-742795fb-3f95-4351-a388-1ee437711b53 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/security-groups?id=01693162-beb1-44c0-8458-46b1f7d34834&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0997915
Jun 01 10:15:16.284007 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-19e7ae52-7d32-4eeb-84bf-521e1f1b31f1 req-1f2c18da-0b55-4656-82a1-aa95a667fff7 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Deleting port 14a54ac6-61b8-43e2-b571-8a9993ebd80c {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:15:16.284580 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-19e7ae52-7d32-4eeb-84bf-521e1f1b31f1 req-1f2c18da-0b55-4656-82a1-aa95a667fff7 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:16.370629 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-f317d415-542b-489e-b7ba-e9ebbbd9ad3a req-e36385af-15b1-4971-89ac-ee6699de68f1 service neutron] 10.222.0.30 "GET /v2.0/networks/c0c2a0bb-c319-4af9-971a-32b17b1a0361?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1388009
Jun 01 10:15:16.427411 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-19e7ae52-7d32-4eeb-84bf-521e1f1b31f1 req-1f2c18da-0b55-4656-82a1-aa95a667fff7 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] For port 14a54ac6-61b8-43e2-b571-8a9993ebd80c, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=14a54ac6-61b8-43e2-b571-8a9993ebd80c,segment=NetworkSegment(4888209f-5226-40f1-b206-246370701bbd),segment_id=4888209f-5226-40f1-b206-246370701bbd)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:16.427764 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-19e7ae52-7d32-4eeb-84bf-521e1f1b31f1 req-1f2c18da-0b55-4656-82a1-aa95a667fff7 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:16.556480 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-19e7ae52-7d32-4eeb-84bf-521e1f1b31f1 req-1f2c18da-0b55-4656-82a1-aa95a667fff7 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Calling delete_port for 14a54ac6-61b8-43e2-b571-8a9993ebd80c owned by compute:nova {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:15:16.741896 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ea9246c-2b8f-42ba-9af7-da533466876c req-bab96ffb-a33c-49b7-82c6-d4cf48742849 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:16.743557 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ea9246c-2b8f-42ba-9af7-da533466876c req-bab96ffb-a33c-49b7-82c6-d4cf48742849 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 946 time: 0.1084957
Jun 01 10:15:16.780208 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-19e7ae52-7d32-4eeb-84bf-521e1f1b31f1 req-1f2c18da-0b55-4656-82a1-aa95a667fff7 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:16.787424 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-0e3d75f1-0f63-426e-9ed7-35cc40f26c79 tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:16.792022 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['14a54ac6-61b8-43e2-b571-8a9993ebd80c'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:15:16.834840 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f2c18da-0b55-4656-82a1-aa95a667fff7 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Pushing event deleted for resources: {'Port': ['ID=14a54ac6-61b8-43e2-b571-8a9993ebd80c,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:16.840937 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ea9246c-2b8f-42ba-9af7-da533466876c req-c3d3df5f-627a-47a9-a15d-0e40b8a948df tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/security-groups?id=4c6403a1-41d1-46bb-a1d5-56a5a21fff27&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0901356
Jun 01 10:15:16.841986 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1f2c18da-0b55-4656-82a1-aa95a667fff7 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:16.921246 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-19e7ae52-7d32-4eeb-84bf-521e1f1b31f1 req-1f2c18da-0b55-4656-82a1-aa95a667fff7 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] No DVR routers for this DVR port 14a54ac6-61b8-43e2-b571-8a9993ebd80c on host hv-cinder-78726 {{(pid=92566) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:15:16.923768 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-19e7ae52-7d32-4eeb-84bf-521e1f1b31f1 req-1f2c18da-0b55-4656-82a1-aa95a667fff7 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:16.926805 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'name': 'network-vif-deleted', 'tag': '14a54ac6-61b8-43e2-b571-8a9993ebd80c'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:15:16.929034 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-20bb1751-ded6-4966-90d2-e8325491be00" -d '{"events": [{"server_uuid": "c52836ef-4dc8-4dd2-a679-e9d0cbeaa489", "name": "network-vif-deleted", "tag": "14a54ac6-61b8-43e2-b571-8a9993ebd80c"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:15:16.969518 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:15:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4fbb60e7-7c3e-4b3b-8622-3e750e8b06a2 x-openstack-request-id: req-4fbb60e7-7c3e-4b3b-8622-3e750e8b06a2 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:15:16.969845 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c52836ef-4dc8-4dd2-a679-e9d0cbeaa489", "name": "network-vif-deleted", "tag": "14a54ac6-61b8-43e2-b571-8a9993ebd80c", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:15:16.970176 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-4fbb60e7-7c3e-4b3b-8622-3e750e8b06a2 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:15:16.970629 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c52836ef-4dc8-4dd2-a679-e9d0cbeaa489', 'name': 'network-vif-deleted', 'tag': '14a54ac6-61b8-43e2-b571-8a9993ebd80c', 'status': 'completed', 'code': 200}
Jun 01 10:15:17.040081 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-19e7ae52-7d32-4eeb-84bf-521e1f1b31f1 req-1f2c18da-0b55-4656-82a1-aa95a667fff7 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.30 "DELETE /v2.0/ports/14a54ac6-61b8-43e2-b571-8a9993ebd80c HTTP/1.1" status: 204  len: 173 time: 0.9444630
Jun 01 10:15:17.436461 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-234ffc2e-21c9-457d-b56f-43cabd925a87 req-e95dc92e-21f6-49b7-852e-5ef0c7f40b7d tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:17.437918 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-234ffc2e-21c9-457d-b56f-43cabd925a87 req-e95dc92e-21f6-49b7-852e-5ef0c7f40b7d tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/ports?device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 947 time: 0.0867202
Jun 01 10:15:17.486104 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-234ffc2e-21c9-457d-b56f-43cabd925a87 req-98b2a2e5-ddcd-43ce-b204-ec0265155235 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/security-groups?id=01693162-beb1-44c0-8458-46b1f7d34834&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421987
Jun 01 10:15:17.743984 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:15:17.890583 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa,segment=NetworkSegment(23fb1f68-b8b8-40f2-b730-865b14c5c5f3),segment_id=23fb1f68-b8b8-40f2-b730-865b14c5c5f3)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:17.907915 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': 'dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa', 'network_id': 'c0c2a0bb-c319-4af9-971a-32b17b1a0361', 'port_id': 'dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa', 'mac_address': 'fa:16:3e:99:8a:1f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 852, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '085f1fc7-30e6-43bf-8c84-be1266ce2fda', 'ip_address': '192.168.233.74'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:15:17.966854 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:17.987547 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:15:18.003918 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa,segment=NetworkSegment(23fb1f68-b8b8-40f2-b730-865b14c5c5f3),segment_id=23fb1f68-b8b8-40f2-b730-865b14c5c5f3)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:18.022128 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-0771ec8b-6f70-4557-937c-aef30551cb76 req-3d93880c-d484-462b-8bcc-b79b5bd90c8a tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Synchronizing usage tracker for tenant:42ccd1aa89a94252b32a254cead654ef on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:15:18.089613 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:18.091711 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:18.153173 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-0771ec8b-6f70-4557-937c-aef30551cb76 req-3d93880c-d484-462b-8bcc-b79b5bd90c8a tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Unset dirty status for tenant:42ccd1aa89a94252b32a254cead654ef on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:15:18.154352 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0771ec8b-6f70-4557-937c-aef30551cb76 req-3d93880c-d484-462b-8bcc-b79b5bd90c8a tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] 10.222.0.68 "GET /v2.0/ports?device_id=c52836ef-4dc8-4dd2-a679-e9d0cbeaa489 HTTP/1.1" status: 200  len: 210 time: 0.1740797
Jun 01 10:15:18.159461 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:18.168998 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:18.168998 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:18.168998 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:18.168998 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:18.169358 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:18.169447 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:18.169709 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:18.170025 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:18.170343 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:18.170658 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:18.171017 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:18.171318 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:18.175590 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:18.358337 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:15:18.684119 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-850e0ca6-9ad0-426f-8b75-ce8d6400c45c req-77e065cf-660f-4ec3-9359-01d35e2478c1 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:18.685587 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-850e0ca6-9ad0-426f-8b75-ce8d6400c45c req-77e065cf-660f-4ec3-9359-01d35e2478c1 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/ports?device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 948 time: 0.0793321
Jun 01 10:15:18.733951 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-850e0ca6-9ad0-426f-8b75-ce8d6400c45c req-62d42c87-2a36-4119-a739-e3ad81472b4d tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/security-groups?id=01693162-beb1-44c0-8458-46b1f7d34834&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427377
Jun 01 10:15:19.759753 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:15:19.934363 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-611d660d-59ce-48ed-b943-2eee0ff30649 req-e2908d75-b204-4aa4-9d30-8aae3f8f525f tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:19.941498 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-611d660d-59ce-48ed-b943-2eee0ff30649 req-e2908d75-b204-4aa4-9d30-8aae3f8f525f tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/ports?device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 948 time: 0.0907013
Jun 01 10:15:19.942819 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:15:19.959739 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:19.959739 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:19.995600 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-611d660d-59ce-48ed-b943-2eee0ff30649 req-683b1589-5e2b-4861-ac48-8ed6727c6332 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/security-groups?id=01693162-beb1-44c0-8458-46b1f7d34834&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0530915
Jun 01 10:15:20.102657 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:20.128183 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bffa2858-4e7e-4a0f-934d-c543b02c90d4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:15:20.130453 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d0702861-4a3d-4914-b24a-d4a12dc6a42f" -d '{"events": [{"server_uuid": "bffa2858-4e7e-4a0f-934d-c543b02c90d4", "name": "network-vif-plugged", "status": "completed", "tag": "dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:15:20.138527 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa,segment=NetworkSegment(23fb1f68-b8b8-40f2-b730-865b14c5c5f3),segment_id=23fb1f68-b8b8-40f2-b730-865b14c5c5f3)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:20.179200 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:15:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cbcca747-972b-47d2-b353-a4f3fd829db1 x-openstack-request-id: req-cbcca747-972b-47d2-b353-a4f3fd829db1 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:15:20.179462 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bffa2858-4e7e-4a0f-934d-c543b02c90d4", "name": "network-vif-plugged", "status": "completed", "tag": "dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:15:20.179742 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-cbcca747-972b-47d2-b353-a4f3fd829db1 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:15:20.180144 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bffa2858-4e7e-4a0f-934d-c543b02c90d4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa', 'code': 200}
Jun 01 10:15:20.249175 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:20.250514 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 14a54ac6-61b8-43e2-b571-8a9993ebd80c no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:15:20.281563 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:20.321628 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: 14a54ac6-61b8-43e2-b571-8a9993ebd80c {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:15:20.321942 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 14a54ac6-61b8-43e2-b571-8a9993ebd80c not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:15:20.349245 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:20.352412 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:20.580291 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94d3aeeb-6c9a-4f2d-9c91-f88ee7eb4173 req-ec7d3950-d0f3-4d1f-99d3-6083bb73ebe7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:20.581764 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-94d3aeeb-6c9a-4f2d-9c91-f88ee7eb4173 req-ec7d3950-d0f3-4d1f-99d3-6083bb73ebe7 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 1102 time: 0.0773528
Jun 01 10:15:20.626449 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-94d3aeeb-6c9a-4f2d-9c91-f88ee7eb4173 req-28bb34ff-7788-4cf5-bca0-e6d9097b2d36 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=01693162-beb1-44c0-8458-46b1f7d34834&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0340374
Jun 01 10:15:20.708860 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39196) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:21.287355 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4c9c23c-6f45-44aa-85dd-e44d3cde08ef req-482c0d73-3307-4ba6-b442-a5bb6aed5321 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:21.287355 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f4c9c23c-6f45-44aa-85dd-e44d3cde08ef req-482c0d73-3307-4ba6-b442-a5bb6aed5321 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/ports?device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 949 time: 0.1774290
Jun 01 10:15:21.347629 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f4c9c23c-6f45-44aa-85dd-e44d3cde08ef req-833918df-33f6-4de6-a6da-e14d0d9d5189 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/security-groups?id=01693162-beb1-44c0-8458-46b1f7d34834&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0517025
Jun 01 10:15:21.430276 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2831ab7f-b44e-4012-960b-9739cbd500ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-401846'] for router_interface, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:21.844533 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-2831ab7f-b44e-4012-960b-9739cbd500ae admin admin] Deleting port 0c15f869-9e44-4931-a089-e90025a105a3 {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:15:21.845144 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2831ab7f-b44e-4012-960b-9739cbd500ae admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:21.977485 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [None req-2831ab7f-b44e-4012-960b-9739cbd500ae admin admin] For port 0c15f869-9e44-4931-a089-e90025a105a3, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=0c15f869-9e44-4931-a089-e90025a105a3,segment=NetworkSegment(4888209f-5226-40f1-b206-246370701bbd),segment_id=4888209f-5226-40f1-b206-246370701bbd)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:21.977920 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2831ab7f-b44e-4012-960b-9739cbd500ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:22.103558 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-2831ab7f-b44e-4012-960b-9739cbd500ae admin admin] Calling delete_port for 0c15f869-9e44-4931-a089-e90025a105a3 owned by network:router_interface {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:15:22.616304 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce1ee4ce-a024-4df4-bdec-e11643c97a1b req-3cc3f19a-1a45-431c-985d-f2977c089b18 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:22.627879 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ce1ee4ce-a024-4df4-bdec-e11643c97a1b req-3cc3f19a-1a45-431c-985d-f2977c089b18 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/ports?device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 949 time: 0.1121566
Jun 01 10:15:22.662684 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ce1ee4ce-a024-4df4-bdec-e11643c97a1b req-8f6009ac-fb5e-43a3-ba15-d05c38d11e0f tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/security-groups?id=01693162-beb1-44c0-8458-46b1f7d34834&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0381873
Jun 01 10:15:22.797281 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2831ab7f-b44e-4012-960b-9739cbd500ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:22.801856 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:22.846484 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2831ab7f-b44e-4012-960b-9739cbd500ae admin admin] Pushing event deleted for resources: {'Port': ['ID=0c15f869-9e44-4931-a089-e90025a105a3,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:22.850889 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-2831ab7f-b44e-4012-960b-9739cbd500ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:23.077651 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39238) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:23.138029 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-2831ab7f-b44e-4012-960b-9739cbd500ae admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7875317', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-405030'] for router_interface, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:23.200420 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:23.215863 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:23.219988 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Usage tracker for resource:security_group_rule and tenant:390315c8c68445edbea49d809c7832ea is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:23.222852 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:23.228603 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:23.311476 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:23.364291 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:23.373538 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-2de62a68-cf63-4da1-a674-e12e6234a745 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:23.413277 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=390315c8c68445edbea49d809c7832ea&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3345501
Jun 01 10:15:23.415035 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ee094560-bbb6-4909-9b28-ff99846ab88b,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:23.417072 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39246) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:23.438831 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:23.439219 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:23.439592 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:23.439957 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:23.440315 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:23.440678 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:23.441031 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:23.441384 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:23.442654 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:23.443040 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:23.443394 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:23.443744 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:23.453271 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f7c7a963-77a3-4487-814e-697e1a7aec9e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:23.481681 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2d0100-6c99-492f-b208-1d850167707b req-9d3b4070-24f6-4237-8f25-4bcd64d900db tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:23.483187 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2e2d0100-6c99-492f-b208-1d850167707b req-9d3b4070-24f6-4237-8f25-4bcd64d900db tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/ports?device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 949 time: 0.1929862
Jun 01 10:15:23.493378 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5248ceb5-1e20-41dc-9537-2ce4bc899673 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:23.520203 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5248ceb5-1e20-41dc-9537-2ce4bc899673 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:23.609776 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2e2d0100-6c99-492f-b208-1d850167707b req-1d0963d3-f4be-458f-8250-4ed395b52088 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/security-groups?id=01693162-beb1-44c0-8458-46b1f7d34834&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1186280
Jun 01 10:15:23.618063 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2831ab7f-b44e-4012-960b-9739cbd500ae admin admin] Router d44c71f4-9c5a-4af0-9ac9-0a309921c707 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92566) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:15:23.654100 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5248ceb5-1e20-41dc-9537-2ce4bc899673 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:23.657984 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-31528acc-82be-4c62-aaa6-c7a395364123 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:23.669361 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5248ceb5-1e20-41dc-9537-2ce4bc899673 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ee094560-bbb6-4909-9b28-ff99846ab88b,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:23.672111 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-5248ceb5-1e20-41dc-9537-2ce4bc899673 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:23.681690 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-5248ceb5-1e20-41dc-9537-2ce4bc899673 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:23.687468 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-5248ceb5-1e20-41dc-9537-2ce4bc899673 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/ee094560-bbb6-4909-9b28-ff99846ab88b HTTP/1.1" status: 204  len: 168 time: 0.2648680
Jun 01 10:15:23.807272 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2831ab7f-b44e-4012-960b-9739cbd500ae admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:15:23.815968 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3cf0d23-d489-47db-9bce-1788c4a9467a None None] Sync routers for ids ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:15:23.825330 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3cf0d23-d489-47db-9bce-1788c4a9467a None None] Routers {'d44c71f4-9c5a-4af0-9ac9-0a309921c707'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:15:23.828312 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-c3cf0d23-d489-47db-9bce-1788c4a9467a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72a61a90>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:15:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:23.902769 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-2831ab7f-b44e-4012-960b-9739cbd500ae admin admin] 10.222.0.68 "PUT /v2.0/routers/d44c71f4-9c5a-4af0-9ac9-0a309921c707/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.1927326
Jun 01 10:15:23.909621 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39252) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:24.004608 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-c3cf0d23-d489-47db-9bce-1788c4a9467a None None] Set router d44c71f4-9c5a-4af0-9ac9-0a309921c707 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:15:24.203033 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] Notify callbacks [] for router, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:24.304259 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-c3cf0d23-d489-47db-9bce-1788c4a9467a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72a61a90>, [{'id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'name': 'tempest-TestMinimumBasicScenario-1893805309-router', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221'}], 'enable_snat': True}, 'gw_port_id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:20Z', 'updated_at': '2021-06-01T10:15:22Z', 'revision_number': 5, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'gw_port': {'id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:01:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:21Z', 'updated_at': '2021-06-01T10:12:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:24.306600 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39258) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:24.308468 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3cf0d23-d489-47db-9bce-1788c4a9467a None None] Checking router: d44c71f4-9c5a-4af0-9ac9-0a309921c707 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:15:24.317685 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3cf0d23-d489-47db-9bce-1788c4a9467a None None] Routers {'d44c71f4-9c5a-4af0-9ac9-0a309921c707'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:15:24.318303 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-c3cf0d23-d489-47db-9bce-1788c4a9467a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe72a61a90>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:15:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:24.325422 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-34b40983-fb1a-49dd-8da7-09fd28d7e590 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:24.341219 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-34b40983-fb1a-49dd-8da7-09fd28d7e590 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:24.345101 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-34b40983-fb1a-49dd-8da7-09fd28d7e590 admin admin] Usage tracker for resource:security_group_rule and tenant:5dab78b39fc04ef99066f1137b105e8c is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:24.348033 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-34b40983-fb1a-49dd-8da7-09fd28d7e590 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:24.353904 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-34b40983-fb1a-49dd-8da7-09fd28d7e590 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:24.390346 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:24.503366 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-c3cf0d23-d489-47db-9bce-1788c4a9467a None None] Set router d44c71f4-9c5a-4af0-9ac9-0a309921c707 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:15:24.503693 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-34b40983-fb1a-49dd-8da7-09fd28d7e590 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:24.547511 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] Deleting port 20ab6db7-2733-4461-a34b-d10f79cc0d29 {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:15:24.547859 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:24.575653 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-34b40983-fb1a-49dd-8da7-09fd28d7e590 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:24.585007 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-cbb0db27-7e63-4ba6-84de-2e4f50eb3c8d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:24.626813 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-34b40983-fb1a-49dd-8da7-09fd28d7e590 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=5dab78b39fc04ef99066f1137b105e8c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3161221
Jun 01 10:15:24.626813 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34b40983-fb1a-49dd-8da7-09fd28d7e590 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=553c5fd4-7006-4b28-b27a-38752d05bb8b,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:24.627808 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39262) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:24.629786 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-34b40983-fb1a-49dd-8da7-09fd28d7e590 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:24.839209 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-c3cf0d23-d489-47db-9bce-1788c4a9467a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe72a61a90>, [{'id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'name': 'tempest-TestMinimumBasicScenario-1893805309-router', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221'}], 'enable_snat': True}, 'gw_port_id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:20Z', 'updated_at': '2021-06-01T10:15:22Z', 'revision_number': 5, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'gw_port': {'id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:01:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:21Z', 'updated_at': '2021-06-01T10:12:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:24.843065 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3cf0d23-d489-47db-9bce-1788c4a9467a None None] The sync data for ids ['d44c71f4-9c5a-4af0-9ac9-0a309921c707'] in dv-cinder-787262-4-iscsi is: [{'id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'name': 'tempest-TestMinimumBasicScenario-1893805309-router', 'tenant_id': '42ccd1aa89a94252b32a254cead654ef', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221'}], 'enable_snat': True}, 'gw_port_id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:20Z', 'updated_at': '2021-06-01T10:15:22Z', 'revision_number': 5, 'project_id': '42ccd1aa89a94252b32a254cead654ef', 'gw_port': {'id': '20ab6db7-2733-4461-a34b-d10f79cc0d29', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:01:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd44c71f4-9c5a-4af0-9ac9-0a309921c707', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.221', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:21Z', 'updated_at': '2021-06-01T10:12:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:15:24.861006 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] For port 20ab6db7-2733-4461-a34b-d10f79cc0d29, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=20ab6db7-2733-4461-a34b-d10f79cc0d29,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:24.861710 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:24.885016 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b8a22a40-01ee-48e9-bf90-36fdf24b7168 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:25.010548 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] Calling delete_port for 20ab6db7-2733-4461-a34b-d10f79cc0d29 owned by network:router_gateway {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:15:25.039332 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b8a22a40-01ee-48e9-bf90-36fdf24b7168 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:25.064531 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ae3caca-d646-4ddc-9c54-8f91e847cd72 req-9ff2bc5f-6902-4d4d-b5ed-8371e9614bfc tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:25.065931 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2ae3caca-d646-4ddc-9c54-8f91e847cd72 req-9ff2bc5f-6902-4d4d-b5ed-8371e9614bfc tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.30 "GET /v2.0/ports?device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 949 time: 0.4175930
Jun 01 10:15:25.156032 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc3c148a-576c-4921-9e42-893db5ae1d78 req-1e39f35e-0795-44f7-a417-05969d067ce3 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:25.157338 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bc3c148a-576c-4921-9e42-893db5ae1d78 req-1e39f35e-0795-44f7-a417-05969d067ce3 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/ports?device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 949 time: 0.3857534
Jun 01 10:15:25.288742 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bc3c148a-576c-4921-9e42-893db5ae1d78 req-b2208550-0b0c-472a-95ab-98c21c3a73d0 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/security-groups?id=01693162-beb1-44c0-8458-46b1f7d34834&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1212258
Jun 01 10:15:25.320617 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-2ae3caca-d646-4ddc-9c54-8f91e847cd72 req-f9632714-1bc0-47c3-b2e8-b632ab980565 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Deleting port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:15:25.320968 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-2ae3caca-d646-4ddc-9c54-8f91e847cd72 req-f9632714-1bc0-47c3-b2e8-b632ab980565 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:25.337879 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b8a22a40-01ee-48e9-bf90-36fdf24b7168 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:25.346685 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-2082f672-9b53-463d-9c6c-fa5c9d4db66a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:25.416743 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a22a40-01ee-48e9-bf90-36fdf24b7168 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=553c5fd4-7006-4b28-b27a-38752d05bb8b,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:25.431216 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b8a22a40-01ee-48e9-bf90-36fdf24b7168 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:25.436179 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b8a22a40-01ee-48e9-bf90-36fdf24b7168 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:25.437310 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-b8a22a40-01ee-48e9-bf90-36fdf24b7168 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/553c5fd4-7006-4b28-b27a-38752d05bb8b HTTP/1.1" status: 204  len: 168 time: 0.8090062
Jun 01 10:15:25.440148 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-20c65635-9627-407d-ab2e-7e3d4d4673bc req-2a79063a-b556-4f9d-b4c7-17210f37a4ac service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0834944
Jun 01 10:15:25.532752 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-2ae3caca-d646-4ddc-9c54-8f91e847cd72 req-f9632714-1bc0-47c3-b2e8-b632ab980565 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] For port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa,segment=NetworkSegment(23fb1f68-b8b8-40f2-b730-865b14c5c5f3),segment_id=23fb1f68-b8b8-40f2-b730-865b14c5c5f3)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:25.533286 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-2ae3caca-d646-4ddc-9c54-8f91e847cd72 req-f9632714-1bc0-47c3-b2e8-b632ab980565 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:25.595636 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20c65635-9627-407d-ab2e-7e3d4d4673bc req-cf5b0d13-e361-4066-a6f8-d4742d2d68f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:25.597153 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-20c65635-9627-407d-ab2e-7e3d4d4673bc req-cf5b0d13-e361-4066-a6f8-d4742d2d68f9 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 1098 time: 0.0752189
Jun 01 10:15:25.605047 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:25.680706 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-2ae3caca-d646-4ddc-9c54-8f91e847cd72 req-f9632714-1bc0-47c3-b2e8-b632ab980565 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Calling delete_port for dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa owned by compute:nova {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:15:25.683586 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f79a3130-e8a2-4300-92ee-9c135dde0b9f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:25.683779 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 0c15f869-9e44-4931-a089-e90025a105a3 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:15:25.717947 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: 0c15f869-9e44-4931-a089-e90025a105a3 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:15:25.718297 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 0c15f869-9e44-4931-a089-e90025a105a3 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:15:25.732478 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] Pushing event deleted for resources: {'Port': ['ID=20ab6db7-2733-4461-a34b-d10f79cc0d29,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:25.760348 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:25.761308 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20c65635-9627-407d-ab2e-7e3d4d4673bc req-a6fdce6d-de7a-41ce-93d8-c710c91a6f13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:25.762896 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-20c65635-9627-407d-ab2e-7e3d4d4673bc req-a6fdce6d-de7a-41ce-93d8-c710c91a6f13 service neutron] 10.222.0.30 "GET /v2.0/networks?id=83aff072-8820-4a36-b8f3-036a7011aace HTTP/1.1" status: 200  len: 910 time: 0.1420789
Jun 01 10:15:25.892711 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-20c65635-9627-407d-ab2e-7e3d4d4673bc req-9fd1b3ea-5425-42e1-85ee-fed1584675fc service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea HTTP/1.1" status: 200  len: 1000 time: 0.1195052
Jun 01 10:15:25.955857 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-403627'] for router_gateway, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:25.976851 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20c65635-9627-407d-ab2e-7e3d4d4673bc req-eec78776-7fcb-4cc7-baf5-1b9d8d5708ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:25.978602 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-20c65635-9627-407d-ab2e-7e3d4d4673bc req-eec78776-7fcb-4cc7-baf5-1b9d8d5708ff service neutron] 10.222.0.30 "GET /v2.0/subnets?id=38dbf18a-9bde-4c4a-b149-d02ad12671d3 HTTP/1.1" status: 200  len: 848 time: 0.0710647
Jun 01 10:15:26.064164 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20c65635-9627-407d-ab2e-7e3d4d4673bc req-683d1d39-79d6-4f20-8eb8-b3f9bb3cdb24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:26.066226 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-20c65635-9627-407d-ab2e-7e3d4d4673bc req-683d1d39-79d6-4f20-8eb8-b3f9bb3cdb24 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=83aff072-8820-4a36-b8f3-036a7011aace&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0769353
Jun 01 10:15:26.138261 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-405542', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-15816'] for router, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:26.140951 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:26.222334 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-20c65635-9627-407d-ab2e-7e3d4d4673bc req-aeefb1a5-8e58-45a1-a7d6-16e633eb3db6 service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1456182
Jun 01 10:15:26.324606 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-406042'] for router, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:26.325174 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d44c71f4-9c5a-4af0-9ac9-0a309921c707 {{(pid=92566) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 10:15:26.352415 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] Notify callbacks [] for router, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:26.357923 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] 10.222.0.68 "DELETE /v2.0/routers/d44c71f4-9c5a-4af0-9ac9-0a309921c707 HTTP/1.1" status: 204  len: 168 time: 2.4448063
Jun 01 10:15:26.359838 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39288) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:26.388295 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [req-20c65635-9627-407d-ab2e-7e3d4d4673bc req-df23b94f-1943-4553-a3df-d50bf8c16d1c service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1562176
Jun 01 10:15:26.416688 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-2ae3caca-d646-4ddc-9c54-8f91e847cd72 req-f9632714-1bc0-47c3-b2e8-b632ab980565 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:26.424786 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-87225543-6c44-4ba0-bde5-71f110877f39 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:26.546687 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:26.549095 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9632714-1bc0-47c3-b2e8-b632ab980565 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Pushing event deleted for resources: {'Port': ['ID=dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:26.558816 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f9632714-1bc0-47c3-b2e8-b632ab980565 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:26.568994 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-2e49787b-d8f6-48db-94f0-72c9853f6b88 req-832a2c79-6b30-4492-813a-60e3e045b936 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Synchronizing usage tracker for tenant:dd194530ace647528541aa8b14f12136 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:15:26.580009 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_v2 [None req-a7d06044-067e-4b4b-9e82-52df3e4650dd admin admin] Deleting subnet dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9 {{(pid=92566) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 10:15:26.615240 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a7d06044-067e-4b4b-9e82-52df3e4650dd admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:26.652396 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-2ae3caca-d646-4ddc-9c54-8f91e847cd72 req-f9632714-1bc0-47c3-b2e8-b632ab980565 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] No DVR routers for this DVR port dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa on host hv-cinder-78726 {{(pid=92566) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:15:26.661138 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-2ae3caca-d646-4ddc-9c54-8f91e847cd72 req-f9632714-1bc0-47c3-b2e8-b632ab980565 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:26.663180 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2ae3caca-d646-4ddc-9c54-8f91e847cd72 req-f9632714-1bc0-47c3-b2e8-b632ab980565 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.30 "DELETE /v2.0/ports/dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa HTTP/1.1" status: 204  len: 173 time: 1.5818591
Jun 01 10:15:26.663764 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bffa2858-4e7e-4a0f-934d-c543b02c90d4', 'name': 'network-vif-deleted', 'tag': 'dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:15:26.666278 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0f4214d9-6923-4ed4-b088-b342cc90dddd" -d '{"events": [{"server_uuid": "bffa2858-4e7e-4a0f-934d-c543b02c90d4", "name": "network-vif-deleted", "tag": "dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:15:26.689061 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a7d06044-067e-4b4b-9e82-52df3e4650dd admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1800618'] for subnet, precommit_delete_associations {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:26.731126 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:15:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fa759ca1-9a51-47f7-8808-35f6e87383e9 x-openstack-request-id: req-fa759ca1-9a51-47f7-8808-35f6e87383e9 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:15:26.731477 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bffa2858-4e7e-4a0f-934d-c543b02c90d4", "name": "network-vif-deleted", "tag": "dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:15:26.731797 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-fa759ca1-9a51-47f7-8808-35f6e87383e9 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:15:26.732272 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bffa2858-4e7e-4a0f-934d-c543b02c90d4', 'name': 'network-vif-deleted', 'tag': 'dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa', 'status': 'completed', 'code': 200}
Jun 01 10:15:26.749373 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-2e49787b-d8f6-48db-94f0-72c9853f6b88 req-832a2c79-6b30-4492-813a-60e3e045b936 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Unset dirty status for tenant:dd194530ace647528541aa8b14f12136 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:15:26.749373 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2e49787b-d8f6-48db-94f0-72c9853f6b88 req-832a2c79-6b30-4492-813a-60e3e045b936 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] 10.222.0.68 "GET /v2.0/ports?device_id=bffa2858-4e7e-4a0f-934d-c543b02c90d4 HTTP/1.1" status: 200  len: 210 time: 0.2880292
Jun 01 10:15:26.841785 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a7d06044-067e-4b4b-9e82-52df3e4650dd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7791835'] for subnet, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:27.181467 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a7d06044-067e-4b4b-9e82-52df3e4650dd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7793006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2818175', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2837889'] for subnet, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:27.185671 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-0e0f6781-c480-41d1-934c-71b8fda9aa81 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:27.224464 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7d06044-067e-4b4b-9e82-52df3e4650dd admin admin] Pushing event deleted for resources: {'Subnet': ['ID=dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:27.227665 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a7d06044-067e-4b4b-9e82-52df3e4650dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:27.228777 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a7d06044-067e-4b4b-9e82-52df3e4650dd admin admin] Notify callbacks [] for subnet, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:27.234120 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42c7450c-97d1-44a7-8d0d-0bd744376cf3 None None] Network d11181a0-389a-4fe3-b44f-805e01bb81e5 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:15:27.235579 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-a7d06044-067e-4b4b-9e82-52df3e4650dd admin admin] 10.222.0.68 "DELETE /v2.0/subnets/dbc9343c-ccb1-45aa-91ff-ce5225fb4bd9 HTTP/1.1" status: 204  len: 168 time: 0.8740344
Jun 01 10:15:27.237454 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39306) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:27.349871 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7813807'] for network, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:27.432380 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Deleting port 444a91a3-4487-42b5-8531-f7f926f82764 {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:15:27.432776 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:27.521190 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28c12af9-094d-4a10-be5f-2196e59c1447 None None] DHCP port deletion for d11181a0-389a-4fe3-b44f-805e01bb81e5 request from dv-cinder-787262-4-iscsi {{(pid=92567) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 10:15:27.549355 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] For port 444a91a3-4487-42b5-8531-f7f926f82764, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=444a91a3-4487-42b5-8531-f7f926f82764,segment=NetworkSegment(4888209f-5226-40f1-b206-246370701bbd),segment_id=4888209f-5226-40f1-b206-246370701bbd)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:27.549747 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:27.606502 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-28c12af9-094d-4a10-be5f-2196e59c1447 None None] Deleting port 444a91a3-4487-42b5-8531-f7f926f82764 {{(pid=92567) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:15:27.607141 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-28c12af9-094d-4a10-be5f-2196e59c1447 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:27.759355 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-28c12af9-094d-4a10-be5f-2196e59c1447 None None] For port 444a91a3-4487-42b5-8531-f7f926f82764, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=444a91a3-4487-42b5-8531-f7f926f82764,segment=NetworkSegment(4888209f-5226-40f1-b206-246370701bbd),segment_id=4888209f-5226-40f1-b206-246370701bbd)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:27.759753 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-28c12af9-094d-4a10-be5f-2196e59c1447 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:27.771589 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 20ab6db7-2733-4461-a34b-d10f79cc0d29 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:15:27.819309 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:15:27.824184 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Calling delete_port for 444a91a3-4487-42b5-8531-f7f926f82764 owned by network:dhcp {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:15:27.905973 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: 20ab6db7-2733-4461-a34b-d10f79cc0d29 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:15:27.906331 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 20ab6db7-2733-4461-a34b-d10f79cc0d29 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:15:27.906764 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 444a91a3-4487-42b5-8531-f7f926f82764 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:15:27.981216 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:27.993905 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-2831ab7f-b44e-4012-960b-9739cbd500ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:28.003992 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-28c12af9-094d-4a10-be5f-2196e59c1447 None None] Calling delete_port for 444a91a3-4487-42b5-8531-f7f926f82764 owned by network:dhcp {{(pid=92567) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:15:28.007529 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:15:28.008458 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device dff5eeb1-a9f6-4bc9-ac0b-df7e3ae835aa not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:15:28.018187 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: 444a91a3-4487-42b5-8531-f7f926f82764 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:15:28.018804 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 444a91a3-4487-42b5-8531-f7f926f82764 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:15:28.045720 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] No DVR routers for this DVR port 444a91a3-4487-42b5-8531-f7f926f82764 on host dv-cinder-787262-4-iscsi {{(pid=92566) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:15:28.064367 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-28c12af9-094d-4a10-be5f-2196e59c1447 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820'] for port, after_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:28.072136 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:28.093128 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Pushing event deleted for resources: {'Port': ['ID=444a91a3-4487-42b5-8531-f7f926f82764,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:28.095790 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:28.118401 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28c12af9-094d-4a10-be5f-2196e59c1447 None None] Pushing event deleted for resources: {'Port': ['ID=444a91a3-4487-42b5-8531-f7f926f82764,revision_number=None']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:28.120518 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28c12af9-094d-4a10-be5f-2196e59c1447 None None] No DVR routers for this DVR port 444a91a3-4487-42b5-8531-f7f926f82764 on host dv-cinder-787262-4-iscsi {{(pid=92567) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:15:28.122110 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-28c12af9-094d-4a10-be5f-2196e59c1447 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:28.189810 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7795028', 'neutron.services.segments.db._delete_segments_for_network-8726958294492'] for network, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:28.203573 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.services.segments.db [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7efe7209b4c0>,) {'filters': {'network_id': ['d11181a0-389a-4fe3-b44f-805e01bb81e5']}} {{(pid=92566) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:28.220396 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.services.segments.db [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7efe7209b4c0>, '4888209f-5226-40f1-b206-246370701bbd') {'for_net_delete': True} {{(pid=92566) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:28.220694 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.services.segments.db [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7efe7209b4c0>, '4888209f-5226-40f1-b206-246370701bbd') {} {{(pid=92566) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:28.233162 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726958303133', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1800609'] for segment, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:28.253502 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:28.256083 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Releasing vlan 868 on physical network physnet1 to pool {{(pid=92566) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 10:15:28.256478 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2757849'] for segment, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]: Traceback (most recent call last):
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:     timer()
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:     cb(*args, **kw)
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:     return func(*args, **kwargs)
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:     self._notify()
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:     self.callback(batched_events)
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:     event.method(event)
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:     return f(self, *a, **k)
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:     return self._get(url).json()
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:     return self.request(url, 'GET', **kwargs)
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 10:15:28.269819 dv-cinder-787262-4-iscsi neutron-server[92566]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 10:15:28.450386 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7795037', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-403638'] for network, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:28.455437 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:28.461201 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:28.487933 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Pushing event deleted for resources: {'Network': ['ID=d11181a0-389a-4fe3-b44f-805e01bb81e5,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:28.501644 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:28.502017 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:28.502383 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:28.502741 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:28.503125 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:28.503517 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:28.503866 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:28.504240 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:28.504670 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:28.505055 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:28.506316 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:28.506696 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:28.510111 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:28.667649 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] 10.222.0.68 "DELETE /v2.0/networks/d11181a0-389a-4fe3-b44f-805e01bb81e5 HTTP/1.1" status: 204  len: 168 time: 1.4287455
Jun 01 10:15:28.670269 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39348) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:29.246607 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4bf4cace-7ae5-4a8f-bff7-edb59f8b263a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-401846'] for router_interface, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:29.745244 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-4bf4cace-7ae5-4a8f-bff7-edb59f8b263a admin admin] Deleting port d2139598-554e-4cfa-9b10-3f093985a6a5 {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:15:29.745700 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4bf4cace-7ae5-4a8f-bff7-edb59f8b263a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:29.871628 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [None req-4bf4cace-7ae5-4a8f-bff7-edb59f8b263a admin admin] For port d2139598-554e-4cfa-9b10-3f093985a6a5, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=d2139598-554e-4cfa-9b10-3f093985a6a5,segment=NetworkSegment(803e39bb-16e7-471c-9371-b6d1deca6924),segment_id=803e39bb-16e7-471c-9371-b6d1deca6924)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:29.873511 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4bf4cace-7ae5-4a8f-bff7-edb59f8b263a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:30.009127 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-4bf4cace-7ae5-4a8f-bff7-edb59f8b263a admin admin] Calling delete_port for d2139598-554e-4cfa-9b10-3f093985a6a5 owned by network:router_interface {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:15:30.273127 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4bf4cace-7ae5-4a8f-bff7-edb59f8b263a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:30.277990 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-762b8afc-21da-4d22-ab61-e550af3e56dd tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:30.327242 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf4cace-7ae5-4a8f-bff7-edb59f8b263a admin admin] Pushing event deleted for resources: {'Port': ['ID=d2139598-554e-4cfa-9b10-3f093985a6a5,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:30.353907 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-4bf4cace-7ae5-4a8f-bff7-edb59f8b263a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:30.632981 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-4bf4cace-7ae5-4a8f-bff7-edb59f8b263a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7875317', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-405030'] for router_interface, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:30.999603 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4bf4cace-7ae5-4a8f-bff7-edb59f8b263a admin admin] Router 0e328557-86fb-4850-b12b-8b85478844e6 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92566) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:15:31.289249 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4bf4cace-7ae5-4a8f-bff7-edb59f8b263a admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:15:31.297515 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d07157e6-6daf-43a6-b329-41f274ed643c None None] Sync routers for ids ['0e328557-86fb-4850-b12b-8b85478844e6'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:15:31.301436 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-4bf4cace-7ae5-4a8f-bff7-edb59f8b263a admin admin] 10.222.0.68 "PUT /v2.0/routers/0e328557-86fb-4850-b12b-8b85478844e6/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6293952
Jun 01 10:15:31.303262 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39522) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:31.308822 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d07157e6-6daf-43a6-b329-41f274ed643c None None] Routers {'0e328557-86fb-4850-b12b-8b85478844e6'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:15:31.309505 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-d07157e6-6daf-43a6-b329-41f274ed643c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe727f48e0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:15:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['0e328557-86fb-4850-b12b-8b85478844e6'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:31.488820 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:15:31.491294 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-04c2c5d4-47bb-4960-90d7-ea59d7a0f080 admin admin] Notify callbacks [] for router, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:31.504977 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-d07157e6-6daf-43a6-b329-41f274ed643c None None] Set router 0e328557-86fb-4850-b12b-8b85478844e6 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:15:31.719238 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-04c2c5d4-47bb-4960-90d7-ea59d7a0f080 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:31.848116 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-d07157e6-6daf-43a6-b329-41f274ed643c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe727f48e0>, [{'id': '0e328557-86fb-4850-b12b-8b85478844e6', 'name': 'tempest-TestMinimumBasicScenario-1300067728-router', 'tenant_id': '9721bcf37577404fb3a206dac7fa327f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.228'}], 'enable_snat': True}, 'gw_port_id': '3fd04673-71e3-44bb-96f0-c953a4732ecf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:31Z', 'updated_at': '2021-06-01T10:15:30Z', 'revision_number': 5, 'project_id': '9721bcf37577404fb3a206dac7fa327f', 'gw_port': {'id': '3fd04673-71e3-44bb-96f0-c953a4732ecf', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:38:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e328557-86fb-4850-b12b-8b85478844e6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:12:32Z', 'updated_at': '2021-06-01T10:12:40Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:31.852035 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d07157e6-6daf-43a6-b329-41f274ed643c None None] Checking router: 0e328557-86fb-4850-b12b-8b85478844e6 for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:15:31.860310 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d07157e6-6daf-43a6-b329-41f274ed643c None None] Routers {'0e328557-86fb-4850-b12b-8b85478844e6'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:15:31.860936 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-d07157e6-6daf-43a6-b329-41f274ed643c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe727f48e0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:15:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['0e328557-86fb-4850-b12b-8b85478844e6'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:31.877951 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-04c2c5d4-47bb-4960-90d7-ea59d7a0f080 admin admin] Deleting port 3fd04673-71e3-44bb-96f0-c953a4732ecf {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:15:31.878525 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-04c2c5d4-47bb-4960-90d7-ea59d7a0f080 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:32.011726 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [None req-04c2c5d4-47bb-4960-90d7-ea59d7a0f080 admin admin] For port 3fd04673-71e3-44bb-96f0-c953a4732ecf, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=3fd04673-71e3-44bb-96f0-c953a4732ecf,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:32.012218 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-04c2c5d4-47bb-4960-90d7-ea59d7a0f080 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:32.037540 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-d07157e6-6daf-43a6-b329-41f274ed643c None None] Set router 0e328557-86fb-4850-b12b-8b85478844e6 gateway port host: None {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:15:32.113170 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39548) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:32.146169 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-04c2c5d4-47bb-4960-90d7-ea59d7a0f080 admin admin] Calling delete_port for 3fd04673-71e3-44bb-96f0-c953a4732ecf owned by network:router_gateway {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:15:32.194049 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-d07157e6-6daf-43a6-b329-41f274ed643c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe727f48e0>, [{'id': '0e328557-86fb-4850-b12b-8b85478844e6', 'name': 'tempest-TestMinimumBasicScenario-1300067728-router', 'tenant_id': '9721bcf37577404fb3a206dac7fa327f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:31Z', 'updated_at': '2021-06-01T10:15:31Z', 'revision_number': 6, 'project_id': '9721bcf37577404fb3a206dac7fa327f', 'gw_port_host': None}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:32.198515 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d07157e6-6daf-43a6-b329-41f274ed643c None None] The sync data for ids ['0e328557-86fb-4850-b12b-8b85478844e6'] in dv-cinder-787262-4-iscsi is: [{'id': '0e328557-86fb-4850-b12b-8b85478844e6', 'name': 'tempest-TestMinimumBasicScenario-1300067728-router', 'tenant_id': '9721bcf37577404fb3a206dac7fa327f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:12:31Z', 'updated_at': '2021-06-01T10:15:31Z', 'revision_number': 6, 'project_id': '9721bcf37577404fb3a206dac7fa327f', 'gw_port_host': None}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:15:32.249887 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-16623e34-9a47-4ae5-adf4-01e06a62141c admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:32.265841 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-16623e34-9a47-4ae5-adf4-01e06a62141c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:32.271092 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-16623e34-9a47-4ae5-adf4-01e06a62141c admin admin] Usage tracker for resource:security_group_rule and tenant:134fa5d477e146e8abc13a875f4c1122 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:32.274182 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-16623e34-9a47-4ae5-adf4-01e06a62141c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:32.280456 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-16623e34-9a47-4ae5-adf4-01e06a62141c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:32.373784 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-16623e34-9a47-4ae5-adf4-01e06a62141c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:32.387121 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-04c2c5d4-47bb-4960-90d7-ea59d7a0f080 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:32.392289 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-58040a77-530d-404a-9257-4a049baa876c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:32.440134 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04c2c5d4-47bb-4960-90d7-ea59d7a0f080 admin admin] Pushing event deleted for resources: {'Port': ['ID=3fd04673-71e3-44bb-96f0-c953a4732ecf,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:32.467098 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-04c2c5d4-47bb-4960-90d7-ea59d7a0f080 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:32.471311 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-16623e34-9a47-4ae5-adf4-01e06a62141c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:32.484316 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b12ac68c-9bf2-4505-8b76-9353add88ab1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:32.525818 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-16623e34-9a47-4ae5-adf4-01e06a62141c admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=134fa5d477e146e8abc13a875f4c1122&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4110003
Jun 01 10:15:32.526133 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39566) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:32.539268 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16623e34-9a47-4ae5-adf4-01e06a62141c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=81a05bc6-dc01-4beb-96d6-dcad28c9bad5,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:32.543307 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-16623e34-9a47-4ae5-adf4-01e06a62141c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:32.585262 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-04c2c5d4-47bb-4960-90d7-ea59d7a0f080 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-403627'] for router_gateway, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:32.798189 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-04c2c5d4-47bb-4960-90d7-ea59d7a0f080 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-405542', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-15816'] for router, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:32.802176 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-04c2c5d4-47bb-4960-90d7-ea59d7a0f080 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:32.810168 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ac8d4b6a-d15d-49b3-8a74-8a13795a4bba admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:32.848453 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ac8d4b6a-d15d-49b3-8a74-8a13795a4bba admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:32.969469 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-04c2c5d4-47bb-4960-90d7-ea59d7a0f080 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-406042'] for router, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:32.970046 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-04c2c5d4-47bb-4960-90d7-ea59d7a0f080 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0e328557-86fb-4850-b12b-8b85478844e6 {{(pid=92566) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 10:15:32.991747 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-04c2c5d4-47bb-4960-90d7-ea59d7a0f080 admin admin] Notify callbacks [] for router, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:32.992890 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-04c2c5d4-47bb-4960-90d7-ea59d7a0f080 admin admin] 10.222.0.68 "DELETE /v2.0/routers/0e328557-86fb-4850-b12b-8b85478844e6 HTTP/1.1" status: 204  len: 168 time: 1.6887085
Jun 01 10:15:32.994076 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ac8d4b6a-d15d-49b3-8a74-8a13795a4bba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:32.995817 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39584) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:32.997426 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-ac8d4b6a-d15d-49b3-8a74-8a13795a4bba admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:32.999738 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-ac8d4b6a-d15d-49b3-8a74-8a13795a4bba admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/81a05bc6-dc01-4beb-96d6-dcad28c9bad5 HTTP/1.1" status: 204  len: 168 time: 0.4718058
Jun 01 10:15:32.999738 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a1808e8c-ea4c-4f77-b4f3-b8613c9792cd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:33.011022 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac8d4b6a-d15d-49b3-8a74-8a13795a4bba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=81a05bc6-dc01-4beb-96d6-dcad28c9bad5,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:33.013299 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-ac8d4b6a-d15d-49b3-8a74-8a13795a4bba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:33.068855 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_v2 [None req-64f6f15d-bfb8-49fb-85a7-3ab3ade3408c admin admin] Deleting subnet 1e6ba067-5116-43a9-829c-16e65dbec6a4 {{(pid=92565) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 10:15:33.072653 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-64f6f15d-bfb8-49fb-85a7-3ab3ade3408c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:33.125876 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-64f6f15d-bfb8-49fb-85a7-3ab3ade3408c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2998467'] for subnet, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:33.212417 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-64f6f15d-bfb8-49fb-85a7-3ab3ade3408c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7791835'] for subnet, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:33.673178 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-64f6f15d-bfb8-49fb-85a7-3ab3ade3408c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7793006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2233195', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3139387'] for subnet, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:33.680191 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b8f5f54f-8954-439c-bec7-2a647df558ea admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:33.715054 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64f6f15d-bfb8-49fb-85a7-3ab3ade3408c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1e6ba067-5116-43a9-829c-16e65dbec6a4,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:33.717865 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-64f6f15d-bfb8-49fb-85a7-3ab3ade3408c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:33.722449 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee3cd617-40c2-4eb5-8fca-c4b0882cfbc9 None None] Network 981d1c8a-385a-4744-9bf1-eed77f908044 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:15:33.727594 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-64f6f15d-bfb8-49fb-85a7-3ab3ade3408c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:33.732303 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-64f6f15d-bfb8-49fb-85a7-3ab3ade3408c admin admin] 10.222.0.68 "DELETE /v2.0/subnets/1e6ba067-5116-43a9-829c-16e65dbec6a4 HTTP/1.1" status: 204  len: 168 time: 0.7348280
Jun 01 10:15:33.734865 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39594) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:33.749910 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device d2139598-554e-4cfa-9b10-3f093985a6a5 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:15:33.841727 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: d2139598-554e-4cfa-9b10-3f093985a6a5 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:15:33.842069 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device d2139598-554e-4cfa-9b10-3f093985a6a5 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:15:33.842486 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 3fd04673-71e3-44bb-96f0-c953a4732ecf no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:15:33.846591 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7813807'] for network, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:33.861342 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39598) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:33.881612 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5ee1d473-1398-4b8d-a40f-25a47a720d31 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:33.883305 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: 3fd04673-71e3-44bb-96f0-c953a4732ecf {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:15:33.883657 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 3fd04673-71e3-44bb-96f0-c953a4732ecf not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:15:33.898624 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-5ee1d473-1398-4b8d-a40f-25a47a720d31 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:33.903350 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-5ee1d473-1398-4b8d-a40f-25a47a720d31 admin admin] Usage tracker for resource:security_group_rule and tenant:c649c5382af44d988824eac44fa27a09 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:33.906346 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-5ee1d473-1398-4b8d-a40f-25a47a720d31 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:33.912213 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-5ee1d473-1398-4b8d-a40f-25a47a720d31 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:33.919970 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] Deleting port a5b75de4-5365-42f2-b609-e23b646786e5 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:15:33.920243 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.008916 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5ee1d473-1398-4b8d-a40f-25a47a720d31 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.041080 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] For port a5b75de4-5365-42f2-b609-e23b646786e5, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=a5b75de4-5365-42f2-b609-e23b646786e5,segment=NetworkSegment(803e39bb-16e7-471c-9371-b6d1deca6924),segment_id=803e39bb-16e7-471c-9371-b6d1deca6924)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:34.041435 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.058761 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5b6ee0f-ec1d-485c-8d7f-ee41dab9cb47 None None] DHCP port deletion for 981d1c8a-385a-4744-9bf1-eed77f908044 request from dv-cinder-787262-4-iscsi {{(pid=92567) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 10:15:34.070857 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5ee1d473-1398-4b8d-a40f-25a47a720d31 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.078072 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a894fb41-ca2f-4cf8-b5c3-3380e90775e4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:34.121280 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-5ee1d473-1398-4b8d-a40f-25a47a720d31 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=c649c5382af44d988824eac44fa27a09&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2586737
Jun 01 10:15:34.122450 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ee1d473-1398-4b8d-a40f-25a47a720d31 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6b32833-9369-47a7-a84d-abc2274efb3d,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:34.125279 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39602) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:34.128390 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-5ee1d473-1398-4b8d-a40f-25a47a720d31 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:34.171557 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] Calling delete_port for a5b75de4-5365-42f2-b609-e23b646786e5 owned by network:dhcp {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:15:34.185857 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-c5b6ee0f-ec1d-485c-8d7f-ee41dab9cb47 None None] Deleting port a5b75de4-5365-42f2-b609-e23b646786e5 {{(pid=92567) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:15:34.186248 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-c5b6ee0f-ec1d-485c-8d7f-ee41dab9cb47 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.197359 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-32b69527-fb0d-4fe3-a6a7-cd90c6bb35d8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.300241 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.302521 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-c5b6ee0f-ec1d-485c-8d7f-ee41dab9cb47 None None] For port a5b75de4-5365-42f2-b609-e23b646786e5, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=a5b75de4-5365-42f2-b609-e23b646786e5,segment=NetworkSegment(803e39bb-16e7-471c-9371-b6d1deca6924),segment_id=803e39bb-16e7-471c-9371-b6d1deca6924)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:34.302950 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-c5b6ee0f-ec1d-485c-8d7f-ee41dab9cb47 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.304949 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b62dcd54-0c49-4ad8-a436-7865bd61fd84 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:34.341571 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-32b69527-fb0d-4fe3-a6a7-cd90c6bb35d8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.358821 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] Pushing event deleted for resources: {'Port': ['ID=a5b75de4-5365-42f2-b609-e23b646786e5,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:34.361825 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:34.365348 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] No DVR routers for this DVR port a5b75de4-5365-42f2-b609-e23b646786e5 on host dv-cinder-787262-4-iscsi {{(pid=92565) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:15:34.436119 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-c5b6ee0f-ec1d-485c-8d7f-ee41dab9cb47 None None] Calling delete_port for a5b75de4-5365-42f2-b609-e23b646786e5 owned by network:dhcp {{(pid=92567) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:15:34.478351 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-c5b6ee0f-ec1d-485c-8d7f-ee41dab9cb47 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820'] for port, after_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.483119 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:34.490087 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7795028', 'neutron.services.segments.db._delete_segments_for_network-8726958294492'] for network, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.499952 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-32b69527-fb0d-4fe3-a6a7-cd90c6bb35d8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.503992 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7efe70e43f10>,) {'filters': {'network_id': ['981d1c8a-385a-4744-9bf1-eed77f908044']}} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:34.504837 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6c151583-3068-4dff-8f5f-0ced3d54a048 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:34.518727 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7efe70e43f10>, '803e39bb-16e7-471c-9371-b6d1deca6924') {'for_net_delete': True} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:34.519200 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7efe70e43f10>, '803e39bb-16e7-471c-9371-b6d1deca6924') {} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:34.524132 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32b69527-fb0d-4fe3-a6a7-cd90c6bb35d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6b32833-9369-47a7-a84d-abc2274efb3d,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:34.526421 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5b6ee0f-ec1d-485c-8d7f-ee41dab9cb47 None None] Pushing event deleted for resources: {'Port': ['ID=a5b75de4-5365-42f2-b609-e23b646786e5,revision_number=None']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:34.529396 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-c5b6ee0f-ec1d-485c-8d7f-ee41dab9cb47 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:34.530424 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5b6ee0f-ec1d-485c-8d7f-ee41dab9cb47 None None] No DVR routers for this DVR port a5b75de4-5365-42f2-b609-e23b646786e5 on host dv-cinder-787262-4-iscsi {{(pid=92567) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:15:34.531091 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-32b69527-fb0d-4fe3-a6a7-cd90c6bb35d8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:34.533470 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-32b69527-fb0d-4fe3-a6a7-cd90c6bb35d8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.534786 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-32b69527-fb0d-4fe3-a6a7-cd90c6bb35d8 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/e6b32833-9369-47a7-a84d-abc2274efb3d HTTP/1.1" status: 204  len: 168 time: 0.4084120
Jun 01 10:15:34.536882 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726958303133', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2998472'] for segment, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.564099 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.571398 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] Releasing vlan 871 on physical network physnet1 to pool {{(pid=92565) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 10:15:34.571954 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2295757'] for segment, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]: Traceback (most recent call last):
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:     timer()
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:     cb(*args, **kw)
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:     return func(*args, **kwargs)
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:     self._notify()
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:     self.callback(batched_events)
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:     event.method(event)
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:     return f(self, *a, **k)
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._get(url).json()
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self.request(url, 'GET', **kwargs)
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 10:15:34.586050 dv-cinder-787262-4-iscsi neutron-server[92565]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 10:15:34.753762 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39614) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:34.758429 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7795037', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-403638'] for network, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.762453 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:34.779198 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:34.788032 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] Pushing event deleted for resources: {'Network': ['ID=981d1c8a-385a-4744-9bf1-eed77f908044,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:34.791214 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:34.795813 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-d57a20c4-bfcd-42ce-a1d7-f44bba8c60e9 admin admin] 10.222.0.68 "DELETE /v2.0/networks/981d1c8a-385a-4744-9bf1-eed77f908044 HTTP/1.1" status: 204  len: 168 time: 1.0597064
Jun 01 10:15:34.964182 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-7ce60e3f-d1c7-4f1a-8066-9677aa3ea34e admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=dd194530ace647528541aa8b14f12136&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2091510
Jun 01 10:15:34.966498 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39626) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:35.027494 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6db635e2-2ffb-4ac6-9ae5-0113443bfca1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:35.054761 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6db635e2-2ffb-4ac6-9ae5-0113443bfca1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:35.175199 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6db635e2-2ffb-4ac6-9ae5-0113443bfca1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:35.180734 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-788a8651-30fb-4f81-ab63-426a13eefc25 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:35.187780 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39636) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:35.194493 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6db635e2-2ffb-4ac6-9ae5-0113443bfca1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=01693162-beb1-44c0-8458-46b1f7d34834,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:35.197246 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6db635e2-2ffb-4ac6-9ae5-0113443bfca1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:35.198537 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6db635e2-2ffb-4ac6-9ae5-0113443bfca1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:35.203130 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-6db635e2-2ffb-4ac6-9ae5-0113443bfca1 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/01693162-beb1-44c0-8458-46b1f7d34834 HTTP/1.1" status: 204  len: 168 time: 0.2320573
Jun 01 10:15:35.247143 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-d139b002-e54f-4896-9063-4f6f842daa97 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=42ccd1aa89a94252b32a254cead654ef&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0575125
Jun 01 10:15:35.249406 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39642) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:35.311010 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1b0c5916-533f-48c2-8bb4-011dff2ef8bc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:35.341965 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1b0c5916-533f-48c2-8bb4-011dff2ef8bc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:35.494249 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1b0c5916-533f-48c2-8bb4-011dff2ef8bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:35.499802 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-e1eec368-d24c-43e5-a007-837c47a4ca10 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:35.515026 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b0c5916-533f-48c2-8bb4-011dff2ef8bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c6403a1-41d1-46bb-a1d5-56a5a21fff27,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:35.517507 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-1b0c5916-533f-48c2-8bb4-011dff2ef8bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:35.523812 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1b0c5916-533f-48c2-8bb4-011dff2ef8bc admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:35.525126 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-1b0c5916-533f-48c2-8bb4-011dff2ef8bc admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/4c6403a1-41d1-46bb-a1d5-56a5a21fff27 HTTP/1.1" status: 204  len: 168 time: 0.2747550
Jun 01 10:15:35.742053 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device a5b75de4-5365-42f2-b609-e23b646786e5 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:15:35.782361 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: a5b75de4-5365-42f2-b609-e23b646786e5 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:15:35.783115 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device a5b75de4-5365-42f2-b609-e23b646786e5 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:15:36.305891 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39664) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:36.356416 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-f154401e-68c7-439b-992e-a70763fed3ad admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=9721bcf37577404fb3a206dac7fa327f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0490155
Jun 01 10:15:36.358538 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39670) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:36.420758 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-248fcc46-337f-4a44-a43d-ad3df03bb239 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:36.446957 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-248fcc46-337f-4a44-a43d-ad3df03bb239 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:36.602783 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-248fcc46-337f-4a44-a43d-ad3df03bb239 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:36.614391 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-1aadead1-b606-4be6-9f6f-5dffd533fa34 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:36.623506 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-248fcc46-337f-4a44-a43d-ad3df03bb239 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb53d77a-bcfc-4b51-aafa-1de3751c229e,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:36.626385 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-248fcc46-337f-4a44-a43d-ad3df03bb239 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:36.628583 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-248fcc46-337f-4a44-a43d-ad3df03bb239 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:36.633415 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-248fcc46-337f-4a44-a43d-ad3df03bb239 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/eb53d77a-bcfc-4b51-aafa-1de3751c229e HTTP/1.1" status: 204  len: 168 time: 0.2704136
Jun 01 10:15:37.603921 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39712) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:37.725912 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-80f3220f-5f33-4427-9783-19907c97895e admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:37.741530 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-80f3220f-5f33-4427-9783-19907c97895e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:37.748066 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-80f3220f-5f33-4427-9783-19907c97895e admin admin] Usage tracker for resource:security_group_rule and tenant:6626c33b531a48f9b6e2a5a56d11e8f7 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:37.751245 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-80f3220f-5f33-4427-9783-19907c97895e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:37.757327 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-80f3220f-5f33-4427-9783-19907c97895e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:37.849119 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-80f3220f-5f33-4427-9783-19907c97895e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:37.904252 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39724) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:37.917995 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-80f3220f-5f33-4427-9783-19907c97895e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:37.926366 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-515f3753-d73f-4584-a186-ae06b414100b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:37.974787 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-80f3220f-5f33-4427-9783-19907c97895e admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=6626c33b531a48f9b6e2a5a56d11e8f7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3671789
Jun 01 10:15:37.974787 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80f3220f-5f33-4427-9783-19907c97895e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9b6a9ed5-91f5-43a5-a68c-bd39ce4e1138,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:37.975077 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39730) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:37.976407 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-80f3220f-5f33-4427-9783-19907c97895e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:38.022566 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1091968561-network', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:15:38.027405 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:38.031545 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Usage tracker for resource:network and tenant:471ae02220fb428c836d64a2bb2bcb76 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:38.034498 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:38.040279 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:38.043028 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-af2278a3-439d-4a9d-8a5a-7ce2a173eea7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:38.069266 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-af2278a3-439d-4a9d-8a5a-7ce2a173eea7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:38.105036 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Made reservation on behalf of 471ae02220fb428c836d64a2bb2bcb76 for: {'network': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:15:38.107432 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:38.121504 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:38.136633 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:38.140496 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Usage tracker for resource:security_group_rule and tenant:471ae02220fb428c836d64a2bb2bcb76 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:38.143353 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:38.149680 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:38.190804 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-af2278a3-439d-4a9d-8a5a-7ce2a173eea7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:38.196241 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b8a22a40-01ee-48e9-bf90-36fdf24b7168 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:38.209134 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af2278a3-439d-4a9d-8a5a-7ce2a173eea7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b6a9ed5-91f5-43a5-a68c-bd39ce4e1138,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:38.212000 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-af2278a3-439d-4a9d-8a5a-7ce2a173eea7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:38.212951 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-af2278a3-439d-4a9d-8a5a-7ce2a173eea7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:38.214058 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-af2278a3-439d-4a9d-8a5a-7ce2a173eea7 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/9b6a9ed5-91f5-43a5-a68c-bd39ce4e1138 HTTP/1.1" status: 204  len: 168 time: 0.2369368
Jun 01 10:15:38.265321 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:38.334121 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:38.337922 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-248fcc46-337f-4a44-a43d-ad3df03bb239 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:38.375789 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 895}  {{(pid=92565) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:15:38.381615 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cf8ffd21-03cc-4285-a534-4474feea7a45,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:38.385157 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:38.388670 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:38.388986 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.segments_db [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Added segment e26992f8-9861-4fb0-83e9-200e0276045e of type vlan for network 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9
Jun 01 10:15:38.417686 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:38.518272 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:38.519488 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:38.520082 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:38.525138 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:38.724213 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Pushing event updated for resources: {'Network': ['ID=5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:38.726810 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:38.734010 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:15:38.782510 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-a822c2fc-aff7-48e4-9fcf-7c3ac4600598 admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.8766010
Jun 01 10:15:38.784962 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39738) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:38.790942 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-99fb28bf-c33d-47bd-a485-5cd849391c35 admin admin] Request body: {'subnet': {'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1091968561-subnet', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'ip_version': 4}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:15:38.795773 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-99fb28bf-c33d-47bd-a485-5cd849391c35 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:38.800573 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-99fb28bf-c33d-47bd-a485-5cd849391c35 admin admin] Usage tracker for resource:subnet and tenant:471ae02220fb428c836d64a2bb2bcb76 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:38.804241 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-99fb28bf-c33d-47bd-a485-5cd849391c35 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:38.809967 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-99fb28bf-c33d-47bd-a485-5cd849391c35 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:38.832147 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39742) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:38.851112 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-32664e11-95ea-40e6-beec-781688f42f00 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:38.865921 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-32664e11-95ea-40e6-beec-781688f42f00 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:38.870148 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-32664e11-95ea-40e6-beec-781688f42f00 admin admin] Usage tracker for resource:security_group_rule and tenant:f42122f64cdd40cc9926b2318d44dadc is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:38.873113 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-32664e11-95ea-40e6-beec-781688f42f00 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:38.879036 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-32664e11-95ea-40e6-beec-781688f42f00 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:38.887091 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-99fb28bf-c33d-47bd-a485-5cd849391c35 admin admin] Made reservation on behalf of 471ae02220fb428c836d64a2bb2bcb76 for: {'subnet': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:15:38.889372 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-99fb28bf-c33d-47bd-a485-5cd849391c35 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3139364'] for subnet, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:39.098721 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-32664e11-95ea-40e6-beec-781688f42f00 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:39.157677 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-32664e11-95ea-40e6-beec-781688f42f00 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:39.165881 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:39.206734 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-32664e11-95ea-40e6-beec-781688f42f00 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=f42122f64cdd40cc9926b2318d44dadc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3735058
Jun 01 10:15:39.209137 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32664e11-95ea-40e6-beec-781688f42f00 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=38eb5eb1-252a-469f-8056-50aebb4585c6,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:39.209989 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39746) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:39.224557 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-32664e11-95ea-40e6-beec-781688f42f00 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:39.271588 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-42d9a246-b845-4e6d-a2dc-8d4db6f0008a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:39.300896 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-42d9a246-b845-4e6d-a2dc-8d4db6f0008a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:39.393691 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-99fb28bf-c33d-47bd-a485-5cd849391c35 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2233128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3139378'] for subnet, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:39.399031 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f86961bb-65b3-4a37-bd46-8871ddd3584f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:39.443857 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-42d9a246-b845-4e6d-a2dc-8d4db6f0008a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:39.448688 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6c4a1807-6d9a-4a87-a652-08ae36e4e3f2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:39.461319 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42d9a246-b845-4e6d-a2dc-8d4db6f0008a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=38eb5eb1-252a-469f-8056-50aebb4585c6,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:39.464113 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-42d9a246-b845-4e6d-a2dc-8d4db6f0008a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:39.467631 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-42d9a246-b845-4e6d-a2dc-8d4db6f0008a admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:39.469525 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-42d9a246-b845-4e6d-a2dc-8d4db6f0008a admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/38eb5eb1-252a-469f-8056-50aebb4585c6 HTTP/1.1" status: 204  len: 168 time: 0.2572885
Jun 01 10:15:39.470227 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99fb28bf-c33d-47bd-a485-5cd849391c35 admin admin] Pushing event updated for resources: {'Subnet': ['ID=24404399-0c0c-45bf-839e-f86b0f5c30d7,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:39.475400 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-99fb28bf-c33d-47bd-a485-5cd849391c35 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:39.479760 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99fb28bf-c33d-47bd-a485-5cd849391c35 admin admin] Checking segment: {'id': 'e26992f8-9861-4fb0-83e9-200e0276045e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92565) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:15:39.480125 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99fb28bf-c33d-47bd-a485-5cd849391c35 admin admin] Network hostable DHCP agents. Network: 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92565) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:15:39.581099 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99fb28bf-c33d-47bd-a485-5cd849391c35 admin admin] Network 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92565) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:15:39.678278 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-99fb28bf-c33d-47bd-a485-5cd849391c35 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9) {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:15:39.686883 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99fb28bf-c33d-47bd-a485-5cd849391c35 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:39.687524 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-99fb28bf-c33d-47bd-a485-5cd849391c35 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:39.688166 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d959478d-e727-4d3c-874e-86b438746222 None None] Network 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:15:39.770015 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-99fb28bf-c33d-47bd-a485-5cd849391c35 admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.9834766
Jun 01 10:15:39.772698 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39752) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:39.777861 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1091968561-router', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:15:39.782479 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:39.786339 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Usage tracker for resource:router and tenant:471ae02220fb428c836d64a2bb2bcb76 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:39.789420 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:39.795439 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:39.867020 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-405701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15802'] for router, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:39.868097 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-407493', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-403482', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-465655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-15793'] for router, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:39.883248 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:39.906753 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ec86312-457d-532c-ad41-c4edfccc592e-5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'fixed_ips': [{'subnet_id': '24404399-0c0c-45bf-839e-f86b0f5c30d7'}]}} from dv-cinder-787262-4-iscsi. {{(pid=92567) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 10:15:39.908194 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:40.070828 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.db_base_plugin_common [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Allocated IP 172.20.0.2 (5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9/24404399-0c0c-45bf-839e-f86b0f5c30d7/80c66ba5-ac11-424a-a1e7-d07b1e821234) {{(pid=92567) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:15:40.222528 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-403519', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-405751', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-15815'] for router, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:40.277660 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Notify callbacks [] for port, precommit_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:40.289220 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Transition to ACTIVE for port object 80c66ba5-ac11-424a-a1e7-d07b1e821234 will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:15:40.307708 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Transition to ACTIVE for port object 80c66ba5-ac11-424a-a1e7-d07b1e821234 will not be triggered until provisioned by entity DHCP. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:15:40.398654 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:40.403886 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:40.488420 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Network 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 is already hosted by enough agents. {{(pid=92567) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:15:40.491244 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.base_scheduler [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Resources bound (agent type, host, resource id):  {{(pid=92567) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:15:40.495541 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Received port after_create {{(pid=92567) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:15:40.497602 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Pushing event updated for resources: {'Port': ['ID=80c66ba5-ac11-424a-a1e7-d07b1e821234,revision_number=1']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:40.501003 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:40.563557 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-ff1dd4a3-2229-430a-920c-4413e6c305fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:40.597095 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:40.629754 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:40.637970 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Attempting to bind port 80c66ba5-ac11-424a-a1e7-d07b1e821234 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:15:40.638333 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Attempting to bind port 80c66ba5-ac11-424a-a1e7-d07b1e821234 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': 'e26992f8-9861-4fb0-83e9-200e0276045e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:15:40.638693 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Attempting to bind port 80c66ba5-ac11-424a-a1e7-d07b1e821234 on network 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:15:40.645108 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 15, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:15:40.645390 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Checking segment: {'id': 'e26992f8-9861-4fb0-83e9-200e0276045e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:15:40.645784 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:40.646169 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Bound using segment: {'id': 'e26992f8-9861-4fb0-83e9-200e0276045e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:15:40.646625 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Bound port: 80c66ba5-ac11-424a-a1e7-d07b1e821234, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e26992f8-9861-4fb0-83e9-200e0276045e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:15:40.647023 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:40.736726 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-356fa685-99b1-4142-b830-b92accd87485 None None] For port 80c66ba5-ac11-424a-a1e7-d07b1e821234, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:15:40.740414 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-356fa685-99b1-4142-b830-b92accd87485 None None] For port 80c66ba5-ac11-424a-a1e7-d07b1e821234, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=80c66ba5-ac11-424a-a1e7-d07b1e821234,segment=NetworkSegment(e26992f8-9861-4fb0-83e9-200e0276045e),segment_id=e26992f8-9861-4fb0-83e9-200e0276045e)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:15:40.777045 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Allocated IP 172.27.2.201 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:15:40.810368 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:40.814983 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-49d721ad-3fc8-4b5d-a8f8-f80bc744fbae None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:40.906426 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Pushing event updated for resources: {'Port': ['ID=80c66ba5-ac11-424a-a1e7-d07b1e821234,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:40.909623 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:40.934831 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:41.002718 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:41.008322 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-60f233ea-2728-4159-b753-ac9f899cacf3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:41.077504 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:15:41.084336 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:15:41.089285 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:15:41.256687 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Pushing event updated for resources: {'Port': ['ID=0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:41.260884 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:41.743627 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:41.790792 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 80c66ba5-ac11-424a-a1e7-d07b1e821234 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:15:41.908575 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51c7907e-8364-4f73-b967-e71fa3b39b43 None None] Network 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:15:41.981555 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 80c66ba5-ac11-424a-a1e7-d07b1e821234 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:15:42.078833 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-b2366e09-14ab-460e-8b5d-f341ad131464 None None] Provisioning for port 80c66ba5-ac11-424a-a1e7-d07b1e821234 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:15:42.094989 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-b2366e09-14ab-460e-8b5d-f341ad131464 None None] Provisioning complete for port 80c66ba5-ac11-424a-a1e7-d07b1e821234 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:42.095374 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b2366e09-14ab-460e-8b5d-f341ad131464 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:42.124792 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-405708', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-403580'] for router, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:42.291617 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b2366e09-14ab-460e-8b5d-f341ad131464 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:42.327900 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-b2366e09-14ab-460e-8b5d-f341ad131464 None None] For port 80c66ba5-ac11-424a-a1e7-d07b1e821234, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=80c66ba5-ac11-424a-a1e7-d07b1e821234,segment=NetworkSegment(e26992f8-9861-4fb0-83e9-200e0276045e),segment_id=e26992f8-9861-4fb0-83e9-200e0276045e)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:42.443460 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b2366e09-14ab-460e-8b5d-f341ad131464 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:42.443760 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Router ab86be34-7347-42c9-9bdf-c507ef094164 is scheduled to L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c with binding_index 1 {{(pid=92566) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 10:15:42.447283 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-17933900-878c-41a0-95f6-2b51b579631e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:42.515254 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2366e09-14ab-460e-8b5d-f341ad131464 None None] Pushing event updated for resources: {'Port': ['ID=80c66ba5-ac11-424a-a1e7-d07b1e821234,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:42.518343 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-b2366e09-14ab-460e-8b5d-f341ad131464 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:42.564846 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-96cf973a-caf5-4562-bffc-8cf3d75743db None None] Provisioning complete for port 80c66ba5-ac11-424a-a1e7-d07b1e821234 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:42.565482 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-96cf973a-caf5-4562-bffc-8cf3d75743db None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:42.641683 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:15:42.665761 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Sync routers for ids ['ab86be34-7347-42c9-9bdf-c507ef094164'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:15:42.696795 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Routers {'ab86be34-7347-42c9-9bdf-c507ef094164'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:15:42.697430 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe71b76fd0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:15:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['ab86be34-7347-42c9-9bdf-c507ef094164'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:42.781010 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39810) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:42.844205 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Notify callbacks [] for router, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:42.845661 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] 10.222.0.68 "POST /v2.0/routers HTTP/1.1" status: 201  len: 921 time: 3.0717576
Jun 01 10:15:42.848338 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39816) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:42.885821 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Set router ab86be34-7347-42c9-9bdf-c507ef094164 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:15:42.906872 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b9bef1d6-63be-4d18-bbe0-f64a6cd6e0d2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:42.921909 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-b9bef1d6-63be-4d18-bbe0-f64a6cd6e0d2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:42.926488 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-b9bef1d6-63be-4d18-bbe0-f64a6cd6e0d2 admin admin] Usage tracker for resource:security_group_rule and tenant:8a70d28cbfae41acb7e4a2425e212dfe is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:42.929874 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-b9bef1d6-63be-4d18-bbe0-f64a6cd6e0d2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:42.935764 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-b9bef1d6-63be-4d18-bbe0-f64a6cd6e0d2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:43.026161 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b9bef1d6-63be-4d18-bbe0-f64a6cd6e0d2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:43.095309 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b9bef1d6-63be-4d18-bbe0-f64a6cd6e0d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:43.104960 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-749b5096-1b80-4c57-82dd-3a6ef97448b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:43.125748 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7f9315ed-9703-4e86-b3ee-d204f72b4194 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:43.144861 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-b9bef1d6-63be-4d18-bbe0-f64a6cd6e0d2 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=8a70d28cbfae41acb7e4a2425e212dfe&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3627009
Jun 01 10:15:43.145908 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9bef1d6-63be-4d18-bbe0-f64a6cd6e0d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7d7ffa1f-65a1-4dae-a1b7-622509086edc,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:43.148325 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39820) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:43.151050 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b9bef1d6-63be-4d18-bbe0-f64a6cd6e0d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:43.211011 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-467f5445-7ab7-4022-9ea8-c784ffb5c6dd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:43.240069 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-467f5445-7ab7-4022-9ea8-c784ffb5c6dd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:43.251269 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe71b76fd0>, [{'id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'name': 'tempest-TestShelveInstance-1091968561-router', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201'}], 'enable_snat': True}, 'gw_port_id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:39Z', 'updated_at': '2021-06-01T10:15:41Z', 'revision_number': 3, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'gw_port': {'id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:a2:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:40Z', 'updated_at': '2021-06-01T10:15:40Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:43.256587 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Checking router: ab86be34-7347-42c9-9bdf-c507ef094164 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:15:43.256942 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Updating router ab86be34-7347-42c9-9bdf-c507ef094164 port 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3 binding host dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:15:43.294054 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:43.326330 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:43.444111 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-467f5445-7ab7-4022-9ea8-c784ffb5c6dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:43.449426 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-4c657c63-6e9c-4424-9ce4-caedf49cddea admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:43.463162 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-467f5445-7ab7-4022-9ea8-c784ffb5c6dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d7ffa1f-65a1-4dae-a1b7-622509086edc,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:43.466556 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-467f5445-7ab7-4022-9ea8-c784ffb5c6dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:43.469011 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-467f5445-7ab7-4022-9ea8-c784ffb5c6dd admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:43.470959 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-467f5445-7ab7-4022-9ea8-c784ffb5c6dd admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/7d7ffa1f-65a1-4dae-a1b7-622509086edc HTTP/1.1" status: 204  len: 168 time: 0.3211865
Jun 01 10:15:43.561577 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:43.762376 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 80c66ba5-ac11-424a-a1e7-d07b1e821234 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:15:43.788522 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Notify callbacks [] for port, precommit_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:43.793276 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Allocated IP 172.20.0.1 (5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9/24404399-0c0c-45bf-839e-f86b0f5c30d7/8fb04901-ea66-4310-aa8b-846af9a44567) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:15:43.823461 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Transition to ACTIVE for port object 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3 will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:15:43.849893 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 80c66ba5-ac11-424a-a1e7-d07b1e821234 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:43.850278 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:43.896016 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:43.902699 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:44.012557 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8247d317-07c6-4d44-a5c3-b74a26dc8369 None None] Pushing event updated for resources: {'Port': ['ID=0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:44.015841 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8247d317-07c6-4d44-a5c3-b74a26dc8369 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:44.016666 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Attempting to bind port 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:15:44.017105 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Attempting to bind port 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:15:44.017540 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Attempting to bind port 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3 on network a961b732-0873-4e86-af5a-7e84ae1a2549 {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:15:44.027578 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 15, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:15:44.027966 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Checking segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:15:44.028390 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:44.028884 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Bound using segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:15:44.029367 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Bound port: 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:15:44.029749 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:44.056903 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:44.073356 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.provisioning_blocks [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Transition to ACTIVE for port object 8fb04901-ea66-4310-aa8b-846af9a44567 will not be triggered until provisioned by entity DHCP. {{(pid=92565) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:15:44.126204 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:44.158376 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] For port 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:15:44.161579 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] For port 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:15:44.168012 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39828) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:44.180308 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:44.185147 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f0f916ce-63c5-4975-af8b-1ef0f62a4ac9 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:44.186057 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8edc9353-04cd-425c-8e7f-459397961cf3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:44.204445 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-8edc9353-04cd-425c-8e7f-459397961cf3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:44.208788 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-8edc9353-04cd-425c-8e7f-459397961cf3 admin admin] Usage tracker for resource:security_group_rule and tenant:a1471db15f0147718d54f88a81345855 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:44.211798 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-8edc9353-04cd-425c-8e7f-459397961cf3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:44.217517 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-8edc9353-04cd-425c-8e7f-459397961cf3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:44.226974 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:44.231232 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:44.251283 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Network 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:15:44.254635 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:15:44.259260 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:15:44.293253 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Pushing event updated for resources: {'Port': ['ID=8fb04901-ea66-4310-aa8b-846af9a44567,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:44.306598 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:44.313696 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8247d317-07c6-4d44-a5c3-b74a26dc8369 None None] Pushing event updated for resources: {'Port': ['ID=0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:44.319257 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8247d317-07c6-4d44-a5c3-b74a26dc8369 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:44.333575 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Routers {'ab86be34-7347-42c9-9bdf-c507ef094164'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:15:44.334304 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe71b76fd0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:15:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['ab86be34-7347-42c9-9bdf-c507ef094164'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:44.339225 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-401677'] for router_interface, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:44.432725 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8edc9353-04cd-425c-8e7f-459397961cf3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:44.524025 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-8edc9353-04cd-425c-8e7f-459397961cf3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:44.530054 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] Set router ab86be34-7347-42c9-9bdf-c507ef094164 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:15:44.533755 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b5b34e78-d0b8-466f-ae85-78af5b668b9f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:44.579059 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-8edc9353-04cd-425c-8e7f-459397961cf3 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=a1471db15f0147718d54f88a81345855&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4076471
Jun 01 10:15:44.579641 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39832) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:44.579988 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8edc9353-04cd-425c-8e7f-459397961cf3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=215fc249-3c99-4884-be6d-8d94abcd37aa,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:44.585221 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-8edc9353-04cd-425c-8e7f-459397961cf3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:44.631330 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-476bc06b-edce-4f0e-ba76-feea8e1bc769 None None] Provisioning for port 8fb04901-ea66-4310-aa8b-846af9a44567 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:15:44.655631 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-476bc06b-edce-4f0e-ba76-feea8e1bc769 None None] Provisioning complete for port 8fb04901-ea66-4310-aa8b-846af9a44567 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:44.656002 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-476bc06b-edce-4f0e-ba76-feea8e1bc769 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:44.678089 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7658a675-c243-45ce-9908-785165e4559f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:44.716736 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:44.726306 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7658a675-c243-45ce-9908-785165e4559f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:44.768817 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-476bc06b-edce-4f0e-ba76-feea8e1bc769 None None] Port 8fb04901-ea66-4310-aa8b-846af9a44567 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:15:44.871339 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe71b76fd0>, [{'id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'name': 'tempest-TestShelveInstance-1091968561-router', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201'}], 'enable_snat': True}, 'gw_port_id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:39Z', 'updated_at': '2021-06-01T10:15:41Z', 'revision_number': 3, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'gw_port': {'id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:a2:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:40Z', 'updated_at': '2021-06-01T10:15:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:44.875142 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7517177f-7c39-4aa3-87b4-2b1f90e415ce None None] The sync data for ids ['ab86be34-7347-42c9-9bdf-c507ef094164'] in dv-cinder-787262-4-iscsi is: [{'id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'name': 'tempest-TestShelveInstance-1091968561-router', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201'}], 'enable_snat': True}, 'gw_port_id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:39Z', 'updated_at': '2021-06-01T10:15:41Z', 'revision_number': 3, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'gw_port': {'id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:a2:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:40Z', 'updated_at': '2021-06-01T10:15:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:15:44.906805 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7658a675-c243-45ce-9908-785165e4559f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:44.911550 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-6adfd760-36cb-4978-b5a8-145225f4a50a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:44.945581 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7658a675-c243-45ce-9908-785165e4559f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=215fc249-3c99-4884-be6d-8d94abcd37aa,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:44.963641 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7658a675-c243-45ce-9908-785165e4559f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:44.977070 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7658a675-c243-45ce-9908-785165e4559f admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:44.978195 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-7658a675-c243-45ce-9908-785165e4559f admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/215fc249-3c99-4884-be6d-8d94abcd37aa HTTP/1.1" status: 204  len: 168 time: 0.3972545
Jun 01 10:15:44.999466 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:45.093441 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2295697'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:45.135676 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7e1ef75e-d858-4fc5-8fdf-70bb409f08e6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:45.221663 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7873030', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-401824'] for router_interface, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:45.231850 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Pushing event updated for resources: {'Port': ['ID=8fb04901-ea66-4310-aa8b-846af9a44567,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:45.235972 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:45.380891 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Network 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:15:45.382115 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:15:45.600758 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Router ab86be34-7347-42c9-9bdf-c507ef094164 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:15:45.713177 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-51d73e5c-c98a-447a-875a-946557ef48c9 None None] Provisioning complete for port 8fb04901-ea66-4310-aa8b-846af9a44567 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:45.713177 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-51d73e5c-c98a-447a-875a-946557ef48c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:45.815625 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-51d73e5c-c98a-447a-875a-946557ef48c9 None None] Port 8fb04901-ea66-4310-aa8b-846af9a44567 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:15:45.845242 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:15:45.896287 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:45.930008 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:15:45.936917 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] 10.222.0.68 "PUT /v2.0/routers/ab86be34-7347-42c9-9bdf-c507ef094164/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.0870094
Jun 01 10:15:45.998024 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:15:46.003243 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:46.004671 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:46.128675 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:46.146823 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:46.220030 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:46.222023 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-4b7ed480-9fa1-4ad3-bbc3-02d884d646ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:46.346440 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:46.350262 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:46.650184 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Sync routers for ids ['ab86be34-7347-42c9-9bdf-c507ef094164'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:15:46.661437 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Routers {'ab86be34-7347-42c9-9bdf-c507ef094164'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:15:46.662063 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe729f9400>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:15:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['ab86be34-7347-42c9-9bdf-c507ef094164'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:46.793118 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39878) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:46.799160 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1143761624-network', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:15:46.804806 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:46.809141 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Usage tracker for resource:network and tenant:2a47e8f3f9e145ef9f900fd364b8d69e is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:46.812766 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:46.819357 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:46.847409 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Set router ab86be34-7347-42c9-9bdf-c507ef094164 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:15:46.889732 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39882) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:46.906595 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Made reservation on behalf of 2a47e8f3f9e145ef9f900fd364b8d69e for: {'network': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:15:46.913438 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-7848220'] for network, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:46.931267 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:46.946421 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:46.950273 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Usage tracker for resource:security_group_rule and tenant:2a47e8f3f9e145ef9f900fd364b8d69e is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:46.953263 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:46.959400 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:47.038757 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1d18c7ed-5ad4-494d-8667-964d17560294 admin admin] Notify callbacks [] for security_group, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.068974 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-1d18c7ed-5ad4-494d-8667-964d17560294 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:47.077005 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-1d18c7ed-5ad4-494d-8667-964d17560294 admin admin] Usage tracker for resource:security_group_rule and tenant:dda01f567f4c49299f256620e388f2ae is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:47.080462 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.081536 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-1d18c7ed-5ad4-494d-8667-964d17560294 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:47.087349 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-1d18c7ed-5ad4-494d-8667-964d17560294 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:47.162010 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe729f9400>, [{'id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'name': 'tempest-TestShelveInstance-1091968561-router', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201'}], 'enable_snat': True}, 'gw_port_id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:39Z', 'updated_at': '2021-06-01T10:15:44Z', 'revision_number': 4, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'gw_port': {'id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:a2:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:40Z', 'updated_at': '2021-06-01T10:15:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '8fb04901-ea66-4310-aa8b-846af9a44567', 'name': '', 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'mac_address': 'fa:16:3e:0c:31:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_interface', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:43Z', 'updated_at': '2021-06-01T10:15:44Z', 'revision_number': 2, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'subnets': [{'id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:47.165752 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.165887 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Checking router: ab86be34-7347-42c9-9bdf-c507ef094164 for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:15:47.166137 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Updating router ab86be34-7347-42c9-9bdf-c507ef094164 port 8fb04901-ea66-4310-aa8b-846af9a44567 binding host dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:15:47.171238 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:47.211629 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 872}  {{(pid=92565) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 10:15:47.217050 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.220198 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0340219f-5e46-4325-8e32-73f73bf00d8b,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:47.226498 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:47.231892 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.232290 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.segments_db [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Added segment 9e12f326-6344-4c0a-b629-df279527972c of type vlan for network b84d4572-17d4-48c6-8bc7-d9db903ef2e8
Jun 01 10:15:47.270924 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726957869141'] for network, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.330141 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1d18c7ed-5ad4-494d-8667-964d17560294 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.409450 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1d18c7ed-5ad4-494d-8667-964d17560294 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.416850 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a9782ece-6807-4b67-b60a-1015a0fa45e1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:47.448136 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324'] for network, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.449304 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:47.449883 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.471406 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-1d18c7ed-5ad4-494d-8667-964d17560294 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=dda01f567f4c49299f256620e388f2ae&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5805225
Jun 01 10:15:47.474947 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39888) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:47.477259 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d18c7ed-5ad4-494d-8667-964d17560294 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2bdda96c-e14a-4d28-9ee0-e2f923d8307e,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:47.483541 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-1d18c7ed-5ad4-494d-8667-964d17560294 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:47.484000 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.024s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:47.549179 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b20671fc-0412-4459-a011-32a876c29854 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.559225 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Notify callbacks [] for port, precommit_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.575716 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] 10.222.0.68 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.7812836
Jun 01 10:15:47.578366 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39892) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:47.578658 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b20671fc-0412-4459-a011-32a876c29854 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.583309 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.provisioning_blocks [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Transition to ACTIVE for port object 8fb04901-ea66-4310-aa8b-846af9a44567 will not be triggered until provisioned by entity L2. {{(pid=92568) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:15:47.586963 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-4b6254fb-4cef-4176-a728-847c9e8c29e5 admin admin] Request body: {'subnet': {'network_id': 'b84d4572-17d4-48c6-8bc7-d9db903ef2e8', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1143761624-subnet', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'ip_version': 4}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:15:47.593614 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Pushing event updated for resources: {'Network': ['ID=b84d4572-17d4-48c6-8bc7-d9db903ef2e8,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:47.595992 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-4b6254fb-4cef-4176-a728-847c9e8c29e5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:47.598503 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-d736cdd0-f48a-4ea7-873b-828f9f224315 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:47.600783 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-4b6254fb-4cef-4176-a728-847c9e8c29e5 admin admin] Usage tracker for resource:subnet and tenant:2a47e8f3f9e145ef9f900fd364b8d69e is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:47.603800 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-4b6254fb-4cef-4176-a728-847c9e8c29e5 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:47.605678 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Network b84d4572-17d4-48c6-8bc7-d9db903ef2e8 details requested by agent ovs-agent-dv-cinder-787262-4-iscsi with host dv-cinder-787262-4-iscsi {{(pid=92567) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 10:15:47.609647 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-4b6254fb-4cef-4176-a728-847c9e8c29e5 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:47.637893 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.642228 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:47.684261 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4b6254fb-4cef-4176-a728-847c9e8c29e5 admin admin] Made reservation on behalf of 2a47e8f3f9e145ef9f900fd364b8d69e for: {'subnet': 1} {{(pid=92565) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:15:47.689645 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4b6254fb-4cef-4176-a728-847c9e8c29e5 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3139364'] for subnet, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.732103 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b20671fc-0412-4459-a011-32a876c29854 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.734597 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-9042ce86-b86a-44e4-99dc-1f71e51f526e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:47.767540 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:15:47.768082 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b20671fc-0412-4459-a011-32a876c29854 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2bdda96c-e14a-4d28-9ee0-e2f923d8307e,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:47.771281 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b20671fc-0412-4459-a011-32a876c29854 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:47.781767 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-b20671fc-0412-4459-a011-32a876c29854 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.783929 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-b20671fc-0412-4459-a011-32a876c29854 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/2bdda96c-e14a-4d28-9ee0-e2f923d8307e HTTP/1.1" status: 204  len: 168 time: 0.3071735
Jun 01 10:15:47.872811 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:47.873411 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.902001 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bdeeb52-543e-4a15-a55e-48928827f7c3 None None] Pushing event updated for resources: {'Port': ['ID=8fb04901-ea66-4310-aa8b-846af9a44567,revision_number=3']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:47.911663 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bdeeb52-543e-4a15-a55e-48928827f7c3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:47.912269 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bdeeb52-543e-4a15-a55e-48928827f7c3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:47.912606 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bdeeb52-543e-4a15-a55e-48928827f7c3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:47.912929 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bdeeb52-543e-4a15-a55e-48928827f7c3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:47.913469 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bdeeb52-543e-4a15-a55e-48928827f7c3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:47.913796 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bdeeb52-543e-4a15-a55e-48928827f7c3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:47.914121 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bdeeb52-543e-4a15-a55e-48928827f7c3 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:47.914445 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bdeeb52-543e-4a15-a55e-48928827f7c3 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:47.914782 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bdeeb52-543e-4a15-a55e-48928827f7c3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:47.915131 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bdeeb52-543e-4a15-a55e-48928827f7c3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:47.915487 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bdeeb52-543e-4a15-a55e-48928827f7c3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:47.915811 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bdeeb52-543e-4a15-a55e-48928827f7c3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92568) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:15:47.919100 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Attempting to bind port 8fb04901-ea66-4310-aa8b-846af9a44567 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:15:47.919461 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Attempting to bind port 8fb04901-ea66-4310-aa8b-846af9a44567 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': 'e26992f8-9861-4fb0-83e9-200e0276045e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9'}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:15:47.919828 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Attempting to bind port 8fb04901-ea66-4310-aa8b-846af9a44567 on network 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:15:47.922095 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-2bdeeb52-543e-4a15-a55e-48928827f7c3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.280s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:47.932130 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 15, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:15:47.932558 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Checking segment: {'id': 'e26992f8-9861-4fb0-83e9-200e0276045e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92568) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:15:47.932924 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:47.933318 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Bound using segment: {'id': 'e26992f8-9861-4fb0-83e9-200e0276045e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9'} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:15:47.933795 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Bound port: 8fb04901-ea66-4310-aa8b-846af9a44567, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e26992f8-9861-4fb0-83e9-200e0276045e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9'}}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:15:47.934176 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:48.038458 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] For port 8fb04901-ea66-4310-aa8b-846af9a44567, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92568) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:15:48.041632 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] For port 8fb04901-ea66-4310-aa8b-846af9a44567, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=8fb04901-ea66-4310-aa8b-846af9a44567,segment=NetworkSegment(e26992f8-9861-4fb0-83e9-200e0276045e),segment_id=e26992f8-9861-4fb0-83e9-200e0276045e)] {{(pid=92568) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:15:48.164353 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:48.170288 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:48.243261 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4b6254fb-4cef-4176-a728-847c9e8c29e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2233128', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3139378'] for subnet, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:48.248672 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Routers {'ab86be34-7347-42c9-9bdf-c507ef094164'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:15:48.249327 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe729f9400>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:15:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['ab86be34-7347-42c9-9bdf-c507ef094164'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:48.249455 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:48.314805 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b6254fb-4cef-4176-a728-847c9e8c29e5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a4b585d7-ef27-470b-b96e-0aa45e5010f2,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:48.318382 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-4b6254fb-4cef-4176-a728-847c9e8c29e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:48.346693 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bdeeb52-543e-4a15-a55e-48928827f7c3 None None] Pushing event updated for resources: {'Port': ['ID=8fb04901-ea66-4310-aa8b-846af9a44567,revision_number=4']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:48.349064 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b6254fb-4cef-4176-a728-847c9e8c29e5 admin admin] Checking segment: {'id': '9e12f326-6344-4c0a-b629-df279527972c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'b84d4572-17d4-48c6-8bc7-d9db903ef2e8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92565) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:15:48.349433 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b6254fb-4cef-4176-a728-847c9e8c29e5 admin admin] Network hostable DHCP agents. Network: b84d4572-17d4-48c6-8bc7-d9db903ef2e8, hostable agents: ['5ca6d3c3-322d-4352-84de-13450689c0b1'], hosted agents: [] {{(pid=92565) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 10:15:48.351210 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-2bdeeb52-543e-4a15-a55e-48928827f7c3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:48.438306 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b6254fb-4cef-4176-a728-847c9e8c29e5 admin admin] Network b84d4572-17d4-48c6-8bc7-d9db903ef2e8 is scheduled to be hosted by DHCP agent 5ca6d3c3-322d-4352-84de-13450689c0b1 with binding_index 1 {{(pid=92565) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 10:15:48.496925 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] Set router ab86be34-7347-42c9-9bdf-c507ef094164 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:15:48.626630 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-4b6254fb-4cef-4176-a728-847c9e8c29e5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-787262-4-iscsi, b84d4572-17d4-48c6-8bc7-d9db903ef2e8) {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:15:48.637519 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6440a6c9-f778-497f-8c60-c749cdefa742 None None] Network b84d4572-17d4-48c6-8bc7-d9db903ef2e8 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:15:48.640557 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b6254fb-4cef-4176-a728-847c9e8c29e5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:15:48.641160 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4b6254fb-4cef-4176-a728-847c9e8c29e5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:48.708090 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-4b6254fb-4cef-4176-a728-847c9e8c29e5 admin admin] 10.222.0.68 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.1286042
Jun 01 10:15:48.710897 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39898) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:48.716008 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1143761624-router', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:15:48.720767 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:48.725783 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Usage tracker for resource:router and tenant:2a47e8f3f9e145ef9f900fd364b8d69e is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:48.728673 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:48.735264 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:48.815915 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe729f9400>, [{'id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'name': 'tempest-TestShelveInstance-1091968561-router', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201'}], 'enable_snat': True}, 'gw_port_id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:39Z', 'updated_at': '2021-06-01T10:15:44Z', 'revision_number': 4, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'gw_port': {'id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:a2:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:40Z', 'updated_at': '2021-06-01T10:15:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '8fb04901-ea66-4310-aa8b-846af9a44567', 'name': '', 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'mac_address': 'fa:16:3e:0c:31:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_interface', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:43Z', 'updated_at': '2021-06-01T10:15:48Z', 'revision_number': 4, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'subnets': [{'id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:48.820973 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e67b08b-0a9b-4a7c-9979-24e48c982b04 None None] The sync data for ids ['ab86be34-7347-42c9-9bdf-c507ef094164'] in dv-cinder-787262-4-iscsi is: [{'id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'name': 'tempest-TestShelveInstance-1091968561-router', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201'}], 'enable_snat': True}, 'gw_port_id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:39Z', 'updated_at': '2021-06-01T10:15:44Z', 'revision_number': 4, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'gw_port': {'id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:a2:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:40Z', 'updated_at': '2021-06-01T10:15:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '8fb04901-ea66-4310-aa8b-846af9a44567', 'name': '', 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'mac_address': 'fa:16:3e:0c:31:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_interface', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:43Z', 'updated_at': '2021-06-01T10:15:48Z', 'revision_number': 4, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'subnets': [{'id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:15:48.825858 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-405701', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-15802'] for router, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:48.827036 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-407493', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-403482', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-465655', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-15793'] for router, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:48.843383 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:48.877493 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6ec86312-457d-532c-ad41-c4edfccc592e-b84d4572-17d4-48c6-8bc7-d9db903ef2e8', 'network_id': 'b84d4572-17d4-48c6-8bc7-d9db903ef2e8', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'fixed_ips': [{'subnet_id': 'a4b585d7-ef27-470b-b96e-0aa45e5010f2'}]}} from dv-cinder-787262-4-iscsi. {{(pid=92567) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 10:15:48.878340 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:49.049983 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.db_base_plugin_common [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Allocated IP 172.20.0.2 (b84d4572-17d4-48c6-8bc7-d9db903ef2e8/a4b585d7-ef27-470b-b96e-0aa45e5010f2/b7308964-c86d-4edc-8c4b-ad84665b6746) {{(pid=92567) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:15:49.200941 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-403519', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-405751', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-15815'] for router, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:49.277927 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Notify callbacks [] for port, precommit_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:49.279551 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Transition to ACTIVE for port object b7308964-c86d-4edc-8c4b-ad84665b6746 will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:15:49.300216 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Transition to ACTIVE for port object b7308964-c86d-4edc-8c4b-ad84665b6746 will not be triggered until provisioned by entity DHCP. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:15:49.382889 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811'] for port, after_create {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:49.388044 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-b2366e09-14ab-460e-8b5d-f341ad131464 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:49.469845 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Network b84d4572-17d4-48c6-8bc7-d9db903ef2e8 is already hosted by enough agents. {{(pid=92567) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:15:49.473818 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.scheduler.base_scheduler [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Resources bound (agent type, host, resource id):  {{(pid=92567) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:15:49.477686 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Received port after_create {{(pid=92567) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:15:49.520007 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Pushing event updated for resources: {'Port': ['ID=b7308964-c86d-4edc-8c4b-ad84665b6746,revision_number=1']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:49.547746 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:49.575779 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Attempting to bind port b7308964-c86d-4edc-8c4b-ad84665b6746 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:15:49.576149 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Attempting to bind port b7308964-c86d-4edc-8c4b-ad84665b6746 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '9e12f326-6344-4c0a-b629-df279527972c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'b84d4572-17d4-48c6-8bc7-d9db903ef2e8'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:15:49.576515 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Attempting to bind port b7308964-c86d-4edc-8c4b-ad84665b6746 on network b84d4572-17d4-48c6-8bc7-d9db903ef2e8 {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:15:49.583205 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 15, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:15:49.583724 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Checking segment: {'id': '9e12f326-6344-4c0a-b629-df279527972c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'b84d4572-17d4-48c6-8bc7-d9db903ef2e8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:15:49.584137 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:49.584536 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Bound using segment: {'id': '9e12f326-6344-4c0a-b629-df279527972c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'b84d4572-17d4-48c6-8bc7-d9db903ef2e8'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:15:49.585066 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Bound port: b7308964-c86d-4edc-8c4b-ad84665b6746, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9e12f326-6344-4c0a-b629-df279527972c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'b84d4572-17d4-48c6-8bc7-d9db903ef2e8'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:15:49.585456 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:49.684005 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] For port b7308964-c86d-4edc-8c4b-ad84665b6746, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:15:49.687308 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] For port b7308964-c86d-4edc-8c4b-ad84665b6746, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=b7308964-c86d-4edc-8c4b-ad84665b6746,segment=NetworkSegment(9e12f326-6344-4c0a-b629-df279527972c),segment_id=9e12f326-6344-4c0a-b629-df279527972c)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:15:49.751240 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:49.764716 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:49.770169 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-b46a6786-a2fa-4bf3-b4ac-b289a653374d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:49.795130 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:49.810925 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 8fb04901-ea66-4310-aa8b-846af9a44567 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:15:49.908505 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Pushing event updated for resources: {'Port': ['ID=b7308964-c86d-4edc-8c4b-ad84665b6746,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:49.911946 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:49.950002 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Allocated IP 172.27.2.118 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/375f5060-c027-4752-a148-f3765076bed3) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:15:49.985637 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 8fb04901-ea66-4310-aa8b-846af9a44567 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:15:49.991199 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 8fb04901-ea66-4310-aa8b-846af9a44567 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:49.991580 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:50.129816 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:50.141821 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:50.177892 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 8fb04901-ea66-4310-aa8b-846af9a44567, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=8fb04901-ea66-4310-aa8b-846af9a44567,segment=NetworkSegment(e26992f8-9861-4fb0-83e9-200e0276045e),segment_id=e26992f8-9861-4fb0-83e9-200e0276045e)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:50.220108 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:50.224035 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b7abf97b-8f60-4483-8f1c-e8392fd5340b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:50.248269 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:50.250232 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:50.292702 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:15:50.295723 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:15:50.301281 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:15:50.319656 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=8fb04901-ea66-4310-aa8b-846af9a44567,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:50.322668 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:50.333374 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Pushing event updated for resources: {'Port': ['ID=375f5060-c027-4752-a148-f3765076bed3,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:50.337703 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:50.747447 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63de0fd0-bc95-4e75-947a-ebe049d208df None None] Network b84d4572-17d4-48c6-8bc7-d9db903ef2e8 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:15:50.759478 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:50.934142 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7b626e18-8df2-445a-aa52-7c18912a62da None None] Provisioning for port b7308964-c86d-4edc-8c4b-ad84665b6746 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:15:51.103483 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-405708', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-403580'] for router, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:51.477709 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Router 39eceb04-a094-494b-91e3-8011703901a1 is scheduled to L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c with binding_index 1 {{(pid=92565) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 10:15:51.656721 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:15:51.665490 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Sync routers for ids ['39eceb04-a094-494b-91e3-8011703901a1'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:15:51.674798 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Routers {'39eceb04-a094-494b-91e3-8011703901a1'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:15:51.675434 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe729b4820>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:15:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['39eceb04-a094-494b-91e3-8011703901a1'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:51.769244 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Notify callbacks [] for router, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:51.770706 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] 10.222.0.68 "POST /v2.0/routers HTTP/1.1" status: 201  len: 921 time: 3.0591516
Jun 01 10:15:51.773661 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39902) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:51.831438 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device b7308964-c86d-4edc-8c4b-ad84665b6746 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:15:51.913871 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Set router 39eceb04-a094-494b-91e3-8011703901a1 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:15:52.130397 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port b7308964-c86d-4edc-8c4b-ad84665b6746 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:15:52.146773 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port b7308964-c86d-4edc-8c4b-ad84665b6746 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:52.147179 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:52.317095 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe729b4820>, [{'id': '39eceb04-a094-494b-91e3-8011703901a1', 'name': 'tempest-TestShelveInstance-1143761624-router', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118'}], 'enable_snat': True}, 'gw_port_id': '375f5060-c027-4752-a148-f3765076bed3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:48Z', 'updated_at': '2021-06-01T10:15:50Z', 'revision_number': 3, 'project_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'gw_port': {'id': '375f5060-c027-4752-a148-f3765076bed3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:be:fb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39eceb04-a094-494b-91e3-8011703901a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:49Z', 'updated_at': '2021-06-01T10:15:49Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:52.324365 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Checking router: 39eceb04-a094-494b-91e3-8011703901a1 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:15:52.324720 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Updating router 39eceb04-a094-494b-91e3-8011703901a1 port 375f5060-c027-4752-a148-f3765076bed3 binding host dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:15:52.360315 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:52.403120 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:52.446759 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port b7308964-c86d-4edc-8c4b-ad84665b6746, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=b7308964-c86d-4edc-8c4b-ad84665b6746,segment=NetworkSegment(9e12f326-6344-4c0a-b629-df279527972c),segment_id=9e12f326-6344-4c0a-b629-df279527972c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:52.462529 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:52.601534 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:52.602296 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 8fb04901-ea66-4310-aa8b-846af9a44567 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:15:52.633375 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:52.671724 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Allocated IP 172.20.0.1 (b84d4572-17d4-48c6-8bc7-d9db903ef2e8/a4b585d7-ef27-470b-b96e-0aa45e5010f2/ada4efcd-4160-49fa-b890-c5d5cd520e7d) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:15:52.749267 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=b7308964-c86d-4edc-8c4b-ad84665b6746,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:52.763340 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:52.785972 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 8fb04901-ea66-4310-aa8b-846af9a44567 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:52.786353 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:52.823374 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:52.839430 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.provisioning_blocks [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Transition to ACTIVE for port object ada4efcd-4160-49fa-b890-c5d5cd520e7d will not be triggered until provisioned by entity DHCP. {{(pid=92565) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:15:52.952836 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:52.959447 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f9b42cb7-57e1-40ff-9cd3-10037573927d tempest-AttachVolumeShelveTestJSON-1099305820 tempest-AttachVolumeShelveTestJSON-1099305820-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:52.961300 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Notify callbacks [] for port, precommit_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:53.011267 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Transition to ACTIVE for port object 375f5060-c027-4752-a148-f3765076bed3 will not be triggered until provisioned by entity L2. {{(pid=92567) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:15:53.021711 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Network b84d4572-17d4-48c6-8bc7-d9db903ef2e8 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:15:53.024651 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:15:53.028637 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:15:53.084453 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:53.089056 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:53.176863 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Attempting to bind port 375f5060-c027-4752-a148-f3765076bed3 on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:15:53.177307 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Attempting to bind port 375f5060-c027-4752-a148-f3765076bed3 by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:15:53.177772 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Attempting to bind port 375f5060-c027-4752-a148-f3765076bed3 on network a961b732-0873-4e86-af5a-7e84ae1a2549 {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:15:53.180382 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb10ea0b-69d3-4733-a244-b7ee2934ba2c None None] Pushing event updated for resources: {'Port': ['ID=375f5060-c027-4752-a148-f3765076bed3,revision_number=2']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:53.184413 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-cb10ea0b-69d3-4733-a244-b7ee2934ba2c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:53.187857 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 15, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:15:53.188273 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Checking segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92567) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:15:53.188883 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:53.189944 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Bound using segment: {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'} {{(pid=92567) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:15:53.190471 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.managers [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Bound port: 375f5060-c027-4752-a148-f3765076bed3, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549'}}] {{(pid=92567) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:15:53.191024 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:53.209830 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Pushing event updated for resources: {'Port': ['ID=ada4efcd-4160-49fa-b890-c5d5cd520e7d,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:53.214876 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.256s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:53.227535 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-401677'] for router_interface, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:53.281985 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] For port 375f5060-c027-4752-a148-f3765076bed3, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92567) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:15:53.285743 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] For port 375f5060-c027-4752-a148-f3765076bed3, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=375f5060-c027-4752-a148-f3765076bed3,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:15:53.478836 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:53.482815 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:53.520520 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-d7eb1348-49c2-4e44-a2f2-e93974f096ed None None] Provisioning for port ada4efcd-4160-49fa-b890-c5d5cd520e7d completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:15:53.545249 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-d7eb1348-49c2-4e44-a2f2-e93974f096ed None None] Provisioning complete for port ada4efcd-4160-49fa-b890-c5d5cd520e7d triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:53.545642 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-d7eb1348-49c2-4e44-a2f2-e93974f096ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:53.566216 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:53.614720 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Routers {'39eceb04-a094-494b-91e3-8011703901a1'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:15:53.615428 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe729b4820>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:15:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['39eceb04-a094-494b-91e3-8011703901a1'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:53.685116 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb10ea0b-69d3-4733-a244-b7ee2934ba2c None None] Pushing event updated for resources: {'Port': ['ID=375f5060-c027-4752-a148-f3765076bed3,revision_number=3']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:53.690774 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-cb10ea0b-69d3-4733-a244-b7ee2934ba2c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:53.691548 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-d7eb1348-49c2-4e44-a2f2-e93974f096ed None None] Port ada4efcd-4160-49fa-b890-c5d5cd520e7d cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:15:53.764662 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device b7308964-c86d-4edc-8c4b-ad84665b6746 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:15:53.805039 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:53.859747 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] Set router 39eceb04-a094-494b-91e3-8011703901a1 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:15:53.889463 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2295697'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:53.916830 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-08235197-c9f7-4d85-a123-78857561a270 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:53.937114 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port b7308964-c86d-4edc-8c4b-ad84665b6746 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:53.937495 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:53.999560 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Pushing event updated for resources: {'Port': ['ID=ada4efcd-4160-49fa-b890-c5d5cd520e7d,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:54.002250 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-7873030', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-401824'] for router_interface, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:54.006413 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:54.137328 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Network b84d4572-17d4-48c6-8bc7-d9db903ef2e8 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:15:54.138541 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:15:54.293231 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe729b4820>, [{'id': '39eceb04-a094-494b-91e3-8011703901a1', 'name': 'tempest-TestShelveInstance-1143761624-router', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118'}], 'enable_snat': True}, 'gw_port_id': '375f5060-c027-4752-a148-f3765076bed3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:48Z', 'updated_at': '2021-06-01T10:15:53Z', 'revision_number': 4, 'project_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'gw_port': {'id': '375f5060-c027-4752-a148-f3765076bed3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:be:fb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39eceb04-a094-494b-91e3-8011703901a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:49Z', 'updated_at': '2021-06-01T10:15:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'ada4efcd-4160-49fa-b890-c5d5cd520e7d', 'name': '', 'network_id': 'b84d4572-17d4-48c6-8bc7-d9db903ef2e8', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'mac_address': 'fa:16:3e:c0:ae:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39eceb04-a094-494b-91e3-8011703901a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'a4b585d7-ef27-470b-b96e-0aa45e5010f2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:52Z', 'updated_at': '2021-06-01T10:15:52Z', 'revision_number': 1, 'project_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'subnets': [{'id': 'a4b585d7-ef27-470b-b96e-0aa45e5010f2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:54.297553 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b66bc58-6095-407e-aecc-c40c326ce5b8 None None] The sync data for ids ['39eceb04-a094-494b-91e3-8011703901a1'] in dv-cinder-787262-4-iscsi is: [{'id': '39eceb04-a094-494b-91e3-8011703901a1', 'name': 'tempest-TestShelveInstance-1143761624-router', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118'}], 'enable_snat': True}, 'gw_port_id': '375f5060-c027-4752-a148-f3765076bed3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:48Z', 'updated_at': '2021-06-01T10:15:53Z', 'revision_number': 4, 'project_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'gw_port': {'id': '375f5060-c027-4752-a148-f3765076bed3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:be:fb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39eceb04-a094-494b-91e3-8011703901a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:49Z', 'updated_at': '2021-06-01T10:15:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'ada4efcd-4160-49fa-b890-c5d5cd520e7d', 'name': '', 'network_id': 'b84d4572-17d4-48c6-8bc7-d9db903ef2e8', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'mac_address': 'fa:16:3e:c0:ae:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39eceb04-a094-494b-91e3-8011703901a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'a4b585d7-ef27-470b-b96e-0aa45e5010f2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:52Z', 'updated_at': '2021-06-01T10:15:52Z', 'revision_number': 1, 'project_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'subnets': [{'id': 'a4b585d7-ef27-470b-b96e-0aa45e5010f2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:15:54.335717 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Router 39eceb04-a094-494b-91e3-8011703901a1 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:15:54.415431 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-dd2ef31c-8e6c-41e6-9eb8-08e029cb6cf2 None None] Provisioning complete for port ada4efcd-4160-49fa-b890-c5d5cd520e7d triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:54.415885 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-dd2ef31c-8e6c-41e6-9eb8-08e029cb6cf2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:54.472965 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-dd2ef31c-8e6c-41e6-9eb8-08e029cb6cf2 None None] Port ada4efcd-4160-49fa-b890-c5d5cd520e7d cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:15:54.538067 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:15:54.548023 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] 10.222.0.68 "PUT /v2.0/routers/39eceb04-a094-494b-91e3-8011703901a1/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7733269
Jun 01 10:15:55.183633 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39922) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:55.189002 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-172a7e1b-bc23-43c6-b9f4-11014fa975de tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-924937826', 'description': 'tempest-secgroup-smoke-924937826 description', 'project_id': '471ae02220fb428c836d64a2bb2bcb76'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:15:55.195444 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-172a7e1b-bc23-43c6-b9f4-11014fa975de tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:55.199275 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-172a7e1b-bc23-43c6-b9f4-11014fa975de tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Usage tracker for resource:security_group and tenant:471ae02220fb428c836d64a2bb2bcb76 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:55.202083 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-172a7e1b-bc23-43c6-b9f4-11014fa975de tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:55.209114 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-172a7e1b-bc23-43c6-b9f4-11014fa975de tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:55.276420 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-172a7e1b-bc23-43c6-b9f4-11014fa975de tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:55.295796 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-172a7e1b-bc23-43c6-b9f4-11014fa975de tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:55.299493 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-172a7e1b-bc23-43c6-b9f4-11014fa975de tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Usage tracker for resource:security_group_rule and tenant:471ae02220fb428c836d64a2bb2bcb76 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:55.302256 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-172a7e1b-bc23-43c6-b9f4-11014fa975de tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:55.308039 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-172a7e1b-bc23-43c6-b9f4-11014fa975de tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:55.379819 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-172a7e1b-bc23-43c6-b9f4-11014fa975de tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:55.455089 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-172a7e1b-bc23-43c6-b9f4-11014fa975de tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:55.459303 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-af2278a3-439d-4a9d-8a5a-7ce2a173eea7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:55.502393 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-172a7e1b-bc23-43c6-b9f4-11014fa975de tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:55.505883 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-172a7e1b-bc23-43c6-b9f4-11014fa975de tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:55.564125 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-172a7e1b-bc23-43c6-b9f4-11014fa975de tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:55.565325 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-172a7e1b-bc23-43c6-b9f4-11014fa975de tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 0.3806815
Jun 01 10:15:55.568843 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39926) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:55.574103 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-7f2eb5c0-28f0-4471-823c-037dd4496fe1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Request body: {'security_group_rule': {'security_group_id': '9c0d5e08-f5eb-42aa-9a8f-dc89327e470c', 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:15:55.580432 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-7f2eb5c0-28f0-4471-823c-037dd4496fe1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:55.584510 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-7f2eb5c0-28f0-4471-823c-037dd4496fe1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Usage tracker for resource:security_group_rule and tenant:471ae02220fb428c836d64a2bb2bcb76 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:55.587460 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-7f2eb5c0-28f0-4471-823c-037dd4496fe1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:55.593391 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-7f2eb5c0-28f0-4471-823c-037dd4496fe1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:55.679321 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7f2eb5c0-28f0-4471-823c-037dd4496fe1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:55.768416 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7f2eb5c0-28f0-4471-823c-037dd4496fe1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:55.773041 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 375f5060-c027-4752-a148-f3765076bed3 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:15:55.855570 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7f2eb5c0-28f0-4471-823c-037dd4496fe1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:55.862340 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-30e0940e-5d97-40be-9359-a5a1e3d47ad3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:55.887382 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f2eb5c0-28f0-4471-823c-037dd4496fe1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5d8bc7fc-f7fa-4355-a7d8-d84245b3cab4,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:55.890003 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7f2eb5c0-28f0-4471-823c-037dd4496fe1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:55.935143 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port 375f5060-c027-4752-a148-f3765076bed3 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:15:55.941834 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 375f5060-c027-4752-a148-f3765076bed3 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:55.941834 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:55.992241 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7f2eb5c0-28f0-4471-823c-037dd4496fe1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:55.993468 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-7f2eb5c0-28f0-4471-823c-037dd4496fe1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.4236875
Jun 01 10:15:55.996449 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39930) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:56.002260 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-1b50d3ae-6df5-41ba-82bd-f0a4d685c65d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Request body: {'security_group_rule': {'security_group_id': '9c0d5e08-f5eb-42aa-9a8f-dc89327e470c', 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:15:56.008048 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-1b50d3ae-6df5-41ba-82bd-f0a4d685c65d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:56.011894 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-1b50d3ae-6df5-41ba-82bd-f0a4d685c65d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Usage tracker for resource:security_group_rule and tenant:471ae02220fb428c836d64a2bb2bcb76 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:56.014787 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-1b50d3ae-6df5-41ba-82bd-f0a4d685c65d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:56.020743 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-1b50d3ae-6df5-41ba-82bd-f0a4d685c65d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:56.062426 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:56.079270 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port 375f5060-c027-4752-a148-f3765076bed3, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=375f5060-c027-4752-a148-f3765076bed3,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:15:56.100232 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1b50d3ae-6df5-41ba-82bd-f0a4d685c65d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:56.135265 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:56.138111 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:56.163486 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1b50d3ae-6df5-41ba-82bd-f0a4d685c65d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:56.205931 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=375f5060-c027-4752-a148-f3765076bed3,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:56.209622 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:56.231995 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1b50d3ae-6df5-41ba-82bd-f0a4d685c65d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:56.233978 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:56.256477 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b50d3ae-6df5-41ba-82bd-f0a4d685c65d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=249123da-86ef-4e79-a48b-7ca55346dd4f,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:56.260922 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1b50d3ae-6df5-41ba-82bd-f0a4d685c65d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:56.323787 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-1b50d3ae-6df5-41ba-82bd-f0a4d685c65d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:56.325012 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-1b50d3ae-6df5-41ba-82bd-f0a4d685c65d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.3274744
Jun 01 10:15:56.327973 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39936) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:56.333943 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-5ae41441-a9f1-4394-bfa9-95db2b3f25b0 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Request body: {'security_group_rule': {'security_group_id': '9c0d5e08-f5eb-42aa-9a8f-dc89327e470c', 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:15:56.340119 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-5ae41441-a9f1-4394-bfa9-95db2b3f25b0 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:56.344071 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-5ae41441-a9f1-4394-bfa9-95db2b3f25b0 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Usage tracker for resource:security_group_rule and tenant:471ae02220fb428c836d64a2bb2bcb76 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:56.347268 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-5ae41441-a9f1-4394-bfa9-95db2b3f25b0 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:56.353844 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-5ae41441-a9f1-4394-bfa9-95db2b3f25b0 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:56.409608 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5ae41441-a9f1-4394-bfa9-95db2b3f25b0 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:56.475169 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5ae41441-a9f1-4394-bfa9-95db2b3f25b0 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:56.551429 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5ae41441-a9f1-4394-bfa9-95db2b3f25b0 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:56.553549 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:56.569336 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:56.576479 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ae41441-a9f1-4394-bfa9-95db2b3f25b0 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3cce6fa7-2508-48f3-ae6c-e62ef9981cce,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:56.593451 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-5ae41441-a9f1-4394-bfa9-95db2b3f25b0 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:56.626146 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Sync routers for ids ['39eceb04-a094-494b-91e3-8011703901a1'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:15:56.636077 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Routers {'39eceb04-a094-494b-91e3-8011703901a1'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:15:56.636683 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe726e21c0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:15:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['39eceb04-a094-494b-91e3-8011703901a1'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:56.655072 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-5ae41441-a9f1-4394-bfa9-95db2b3f25b0 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:56.656301 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-5ae41441-a9f1-4394-bfa9-95db2b3f25b0 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.3273952
Jun 01 10:15:56.659049 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39940) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:56.664495 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-6a0319b2-163b-425c-b0ea-b4d0986cf132 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Request body: {'security_group_rule': {'security_group_id': '9c0d5e08-f5eb-42aa-9a8f-dc89327e470c', 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:15:56.670451 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6a0319b2-163b-425c-b0ea-b4d0986cf132 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:56.674223 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6a0319b2-163b-425c-b0ea-b4d0986cf132 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Usage tracker for resource:security_group_rule and tenant:471ae02220fb428c836d64a2bb2bcb76 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:56.677207 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-6a0319b2-163b-425c-b0ea-b4d0986cf132 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:56.683418 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-6a0319b2-163b-425c-b0ea-b4d0986cf132 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:56.781081 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6a0319b2-163b-425c-b0ea-b4d0986cf132 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:56.814349 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Set router 39eceb04-a094-494b-91e3-8011703901a1 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:15:56.846834 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6a0319b2-163b-425c-b0ea-b4d0986cf132 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:56.918242 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6a0319b2-163b-425c-b0ea-b4d0986cf132 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:56.922001 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:56.944473 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a0319b2-163b-425c-b0ea-b4d0986cf132 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=beeb0541-ecd8-4fac-ac05-f92992fe5341,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:56.946946 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6a0319b2-163b-425c-b0ea-b4d0986cf132 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:57.015531 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-6a0319b2-163b-425c-b0ea-b4d0986cf132 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:57.016752 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-6a0319b2-163b-425c-b0ea-b4d0986cf132 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.3567386
Jun 01 10:15:57.019427 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 39944) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:57.024528 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [None req-a8cc28c7-9d6e-4991-89d0-d3aa1330bba7 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Request body: {'security_group_rule': {'security_group_id': '9c0d5e08-f5eb-42aa-9a8f-dc89327e470c', 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:15:57.030303 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-a8cc28c7-9d6e-4991-89d0-d3aa1330bba7 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:57.034309 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-a8cc28c7-9d6e-4991-89d0-d3aa1330bba7 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Usage tracker for resource:security_group_rule and tenant:471ae02220fb428c836d64a2bb2bcb76 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:57.037458 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [None req-a8cc28c7-9d6e-4991-89d0-d3aa1330bba7 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:57.043374 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [None req-a8cc28c7-9d6e-4991-89d0-d3aa1330bba7 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:57.130085 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.securitygroups_db [None req-a8cc28c7-9d6e-4991-89d0-d3aa1330bba7 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Project 471ae02220fb428c836d64a2bb2bcb76 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 10:15:57.132621 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe726e21c0>, [{'id': '39eceb04-a094-494b-91e3-8011703901a1', 'name': 'tempest-TestShelveInstance-1143761624-router', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118'}], 'enable_snat': True}, 'gw_port_id': '375f5060-c027-4752-a148-f3765076bed3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:48Z', 'updated_at': '2021-06-01T10:15:53Z', 'revision_number': 4, 'project_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'gw_port': {'id': '375f5060-c027-4752-a148-f3765076bed3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:be:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39eceb04-a094-494b-91e3-8011703901a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:49Z', 'updated_at': '2021-06-01T10:15:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'ada4efcd-4160-49fa-b890-c5d5cd520e7d', 'name': '', 'network_id': 'b84d4572-17d4-48c6-8bc7-d9db903ef2e8', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'mac_address': 'fa:16:3e:c0:ae:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39eceb04-a094-494b-91e3-8011703901a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'a4b585d7-ef27-470b-b96e-0aa45e5010f2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:52Z', 'updated_at': '2021-06-01T10:15:53Z', 'revision_number': 2, 'project_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'subnets': [{'id': 'a4b585d7-ef27-470b-b96e-0aa45e5010f2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:57.136571 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Checking router: 39eceb04-a094-494b-91e3-8011703901a1 for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:15:57.141084 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a8cc28c7-9d6e-4991-89d0-d3aa1330bba7 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:57.141207 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Updating router 39eceb04-a094-494b-91e3-8011703901a1 port ada4efcd-4160-49fa-b890-c5d5cd520e7d binding host dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 10:15:57.190864 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:57.210929 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a8cc28c7-9d6e-4991-89d0-d3aa1330bba7 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:57.272261 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a8cc28c7-9d6e-4991-89d0-d3aa1330bba7 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:57.274593 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1b50d3ae-6df5-41ba-82bd-f0a4d685c65d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:57.297550 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8cc28c7-9d6e-4991-89d0-d3aa1330bba7 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fdb56794-74ac-4bde-a5ae-af5368836eac,revision_number=0']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:57.300253 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-a8cc28c7-9d6e-4991-89d0-d3aa1330bba7 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:57.392276 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-a8cc28c7-9d6e-4991-89d0-d3aa1330bba7 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:57.393453 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-a8cc28c7-9d6e-4991-89d0-d3aa1330bba7 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.3730848
Jun 01 10:15:57.397614 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 39954) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:15:57.404259 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-9f348300-049e-4f51-86ad-d0bbe72902e6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Request body: {'security_group_rule': {'security_group_id': '9c0d5e08-f5eb-42aa-9a8f-dc89327e470c', 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:15:57.410784 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-9f348300-049e-4f51-86ad-d0bbe72902e6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:15:57.414745 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-9f348300-049e-4f51-86ad-d0bbe72902e6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Usage tracker for resource:security_group_rule and tenant:471ae02220fb428c836d64a2bb2bcb76 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:15:57.417608 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-9f348300-049e-4f51-86ad-d0bbe72902e6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:15:57.423425 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-9f348300-049e-4f51-86ad-d0bbe72902e6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:15:57.501421 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.securitygroups_db [None req-9f348300-049e-4f51-86ad-d0bbe72902e6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Project 471ae02220fb428c836d64a2bb2bcb76 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 10:15:57.508390 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9f348300-049e-4f51-86ad-d0bbe72902e6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:57.542522 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Notify callbacks [] for port, precommit_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:57.557455 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.provisioning_blocks [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Transition to ACTIVE for port object ada4efcd-4160-49fa-b890-c5d5cd520e7d will not be triggered until provisioned by entity L2. {{(pid=92568) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:15:57.580275 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9f348300-049e-4f51-86ad-d0bbe72902e6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:57.620918 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9f348300-049e-4f51-86ad-d0bbe72902e6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522909'] for security_group_rule, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:57.621200 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:57.626612 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-e92e7cb7-71e4-470a-8f0e-74f4461a07e7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:57.628738 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-d65d1cf8-7a7a-4f56-8b20-0e189fb48403 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:57.657097 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f348300-049e-4f51-86ad-d0bbe72902e6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=736aa634-2782-4602-8d83-be5e695a759f,revision_number=0']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:57.657097 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-9f348300-049e-4f51-86ad-d0bbe72902e6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:57.731139 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9f348300-049e-4f51-86ad-d0bbe72902e6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group_rule, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:57.732929 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-9f348300-049e-4f51-86ad-d0bbe72902e6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.3333921
Jun 01 10:15:57.780272 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 375f5060-c027-4752-a148-f3765076bed3 up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:15:57.872301 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Attempting to bind port ada4efcd-4160-49fa-b890-c5d5cd520e7d on host dv-cinder-787262-4-iscsi for vnic_type normal with profile  {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:15:57.872767 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Attempting to bind port ada4efcd-4160-49fa-b890-c5d5cd520e7d by drivers openvswitch,hyperv on host dv-cinder-787262-4-iscsi at level 0 using segments [{'id': '9e12f326-6344-4c0a-b629-df279527972c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'b84d4572-17d4-48c6-8bc7-d9db903ef2e8'}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:15:57.873019 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Attempting to bind port ada4efcd-4160-49fa-b890-c5d5cd520e7d on network b84d4572-17d4-48c6-8bc7-d9db903ef2e8 {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:15:57.879213 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f41122f0-0131-4837-b410-20a3c9883cc6 None None] Pushing event updated for resources: {'Port': ['ID=ada4efcd-4160-49fa-b890-c5d5cd520e7d,revision_number=3']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:57.883342 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-f41122f0-0131-4837-b410-20a3c9883cc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:57.884243 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Checking agent: {'id': 'f0ff5e09-222b-4082-9c9d-4bc08ab714bb', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-787262-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 9, 58, 13), 'started_at': datetime.datetime(2021, 6, 1, 9, 58, 43), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 15, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-787262-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:15:57.884613 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Checking segment: {'id': '9e12f326-6344-4c0a-b629-df279527972c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'b84d4572-17d4-48c6-8bc7-d9db903ef2e8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92568) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:15:57.885005 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:57.885578 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Bound using segment: {'id': '9e12f326-6344-4c0a-b629-df279527972c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'b84d4572-17d4-48c6-8bc7-d9db903ef2e8'} {{(pid=92568) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:15:57.886223 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.managers [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Bound port: ada4efcd-4160-49fa-b890-c5d5cd520e7d, host: dv-cinder-787262-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9e12f326-6344-4c0a-b629-df279527972c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'b84d4572-17d4-48c6-8bc7-d9db903ef2e8'}}] {{(pid=92568) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:15:57.886781 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:57.900154 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port 375f5060-c027-4752-a148-f3765076bed3 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:57.900773 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:57.989920 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] For port ada4efcd-4160-49fa-b890-c5d5cd520e7d, host dv-cinder-787262-4-iscsi, cleared binding levels {{(pid=92568) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:15:57.993288 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.plugins.ml2.db [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] For port ada4efcd-4160-49fa-b890-c5d5cd520e7d, host dv-cinder-787262-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=ada4efcd-4160-49fa-b890-c5d5cd520e7d,segment=NetworkSegment(9e12f326-6344-4c0a-b629-df279527972c),segment_id=9e12f326-6344-4c0a-b629-df279527972c)] {{(pid=92568) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:15:58.107013 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron_lib.callbacks.manager [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92568) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:15:58.111835 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:15:58.189193 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f41122f0-0131-4837-b410-20a3c9883cc6 None None] Pushing event updated for resources: {'Port': ['ID=ada4efcd-4160-49fa-b890-c5d5cd520e7d,revision_number=4']} {{(pid=92568) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:15:58.196784 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Routers {'39eceb04-a094-494b-91e3-8011703901a1'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:15:58.198257 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe726e21c0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:15:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['39eceb04-a094-494b-91e3-8011703901a1'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:58.254934 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG oslo_concurrency.lockutils [None req-f41122f0-0131-4837-b410-20a3c9883cc6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=92568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:15:58.402650 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] Set router 39eceb04-a094-494b-91e3-8011703901a1 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:15:58.716654 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe726e21c0>, [{'id': '39eceb04-a094-494b-91e3-8011703901a1', 'name': 'tempest-TestShelveInstance-1143761624-router', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118'}], 'enable_snat': True}, 'gw_port_id': '375f5060-c027-4752-a148-f3765076bed3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:48Z', 'updated_at': '2021-06-01T10:15:53Z', 'revision_number': 4, 'project_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'gw_port': {'id': '375f5060-c027-4752-a148-f3765076bed3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:be:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39eceb04-a094-494b-91e3-8011703901a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:49Z', 'updated_at': '2021-06-01T10:15:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'ada4efcd-4160-49fa-b890-c5d5cd520e7d', 'name': '', 'network_id': 'b84d4572-17d4-48c6-8bc7-d9db903ef2e8', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'mac_address': 'fa:16:3e:c0:ae:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39eceb04-a094-494b-91e3-8011703901a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'a4b585d7-ef27-470b-b96e-0aa45e5010f2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:52Z', 'updated_at': '2021-06-01T10:15:57Z', 'revision_number': 4, 'project_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'subnets': [{'id': 'a4b585d7-ef27-470b-b96e-0aa45e5010f2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:15:58.720557 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21e1929d-3793-49ba-a67c-a60cc695b558 None None] The sync data for ids ['39eceb04-a094-494b-91e3-8011703901a1'] in dv-cinder-787262-4-iscsi is: [{'id': '39eceb04-a094-494b-91e3-8011703901a1', 'name': 'tempest-TestShelveInstance-1143761624-router', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118'}], 'enable_snat': True}, 'gw_port_id': '375f5060-c027-4752-a148-f3765076bed3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:48Z', 'updated_at': '2021-06-01T10:15:53Z', 'revision_number': 4, 'project_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'gw_port': {'id': '375f5060-c027-4752-a148-f3765076bed3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:be:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39eceb04-a094-494b-91e3-8011703901a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:49Z', 'updated_at': '2021-06-01T10:15:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'ada4efcd-4160-49fa-b890-c5d5cd520e7d', 'name': '', 'network_id': 'b84d4572-17d4-48c6-8bc7-d9db903ef2e8', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'mac_address': 'fa:16:3e:c0:ae:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39eceb04-a094-494b-91e3-8011703901a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'a4b585d7-ef27-470b-b96e-0aa45e5010f2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:52Z', 'updated_at': '2021-06-01T10:15:57Z', 'revision_number': 4, 'project_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'subnets': [{'id': 'a4b585d7-ef27-470b-b96e-0aa45e5010f2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:15:59.763250 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device ada4efcd-4160-49fa-b890-c5d5cd520e7d up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:15:59.895517 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning for port ada4efcd-4160-49fa-b890-c5d5cd520e7d completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:15:59.901335 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port ada4efcd-4160-49fa-b890-c5d5cd520e7d triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:15:59.901722 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:00.024919 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:00.057621 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] For port ada4efcd-4160-49fa-b890-c5d5cd520e7d, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=ada4efcd-4160-49fa-b890-c5d5cd520e7d,segment=NetworkSegment(9e12f326-6344-4c0a-b629-df279527972c),segment_id=9e12f326-6344-4c0a-b629-df279527972c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:16:00.135324 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:00.137318 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8247d317-07c6-4d44-a5c3-b74a26dc8369 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:16:00.206750 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Pushing event updated for resources: {'Port': ['ID=ada4efcd-4160-49fa-b890-c5d5cd520e7d,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:16:00.210014 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:16:01.751033 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-e1667e17-7655-45b8-9175-d0e96fae8cf2 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-881588482&fields=id&tenant_id=cfa9132b1ba044548228b96f6c2755eb HTTP/1.1" status: 200  len: 267 time: 0.0451066
Jun 01 10:16:01.761595 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device ada4efcd-4160-49fa-b890-c5d5cd520e7d up at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:16:01.830676 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Provisioning complete for port ada4efcd-4160-49fa-b890-c5d5cd520e7d triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:16:01.831225 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:01.906493 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-aded5828-507e-429a-b3ab-fd05936eebda tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:01.907873 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-aded5828-507e-429a-b3ab-fd05936eebda tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/networks?id=83aff072-8820-4a36-b8f3-036a7011aace HTTP/1.1" status: 200  len: 809 time: 0.1494441
Jun 01 10:16:01.923976 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-f8f8240f-a2da-445d-9595-20b1509e24c1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/quotas/cfa9132b1ba044548228b96f6c2755eb HTTP/1.1" status: 200  len: 375 time: 0.0105796
Jun 01 10:16:02.021539 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-b019e546-33ff-47bf-8cf5-b818981b0930 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&fields=id HTTP/1.1" status: 200  len: 440 time: 0.0921087
Jun 01 10:16:02.164014 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-2e51df9e-6a4f-4bb6-958b-3266b52a7131 service neutron] 10.222.0.68 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1310074
Jun 01 10:16:02.299757 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-3cb0dc75-1a69-4e0c-bba1-b6c03f8e104b service neutron] 10.222.0.68 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1295004
Jun 01 10:16:03.016456 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-42316876-3dc5-4b18-9883-6072ab5598ec req-877e2449-d368-4b79-9b50-e9837a758558 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 210 time: 0.0446951
Jun 01 10:16:04.172558 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e9c0a6aa-b76d-488b-9c9f-337f7a89ee36 req-74322e82-b89f-46d7-ad38-1e51076610b2 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 210 time: 0.0470321
Jun 01 10:16:05.195881 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-eeea6a03-eb75-40cd-a657-4bf36eaa2253 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:05.197329 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-eeea6a03-eb75-40cd-a657-4bf36eaa2253 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.30 "GET /v2.0/networks?id=83aff072-8820-4a36-b8f3-036a7011aace HTTP/1.1" status: 200  len: 809 time: 0.1556680
Jun 01 10:16:05.249602 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-6129b74f-c853-498c-bc02-b8e68c60b4b7 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=cfa9132b1ba044548228b96f6c2755eb HTTP/1.1" status: 200  len: 379 time: 0.0425465
Jun 01 10:16:05.259961 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Request body: {'port': {'device_id': '21a80279-3681-4303-b5c5-114fcc3aae4f', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'admin_state_up': True, 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'security_groups': ['53e3d69f-76f1-4e9a-808e-b6a7c88db3f4']}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:16:05.421701 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:16:05.427156 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Usage tracker for resource:port and tenant:cfa9132b1ba044548228b96f6c2755eb is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:16:05.430283 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Quota usage for port was recalculated. Used quota:5. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:16:05.436367 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attempting to reserve 1 items for resource port. Total usage: 5; quota limit: 500; headroom:495 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:16:05.508306 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f7d50893-b7ed-435d-81f4-fb37aa760703 req-2f209b42-b9ce-4d10-a6ed-7ae830d59e00 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 210 time: 0.1759999
Jun 01 10:16:05.518363 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Made reservation on behalf of cfa9132b1ba044548228b96f6c2755eb for: {'port': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:16:05.521918 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:05.778324 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Allocated IP 172.20.0.6 (83aff072-8820-4a36-b8f3-036a7011aace/38dbf18a-9bde-4c4a-b149-d02ad12671d3/76ab4fe7-d435-44e6-8eac-07c05d50efc4) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:16:05.971383 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:05.987238 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Transition to ACTIVE for port object 76ab4fe7-d435-44e6-8eac-07c05d50efc4 will not be triggered until provisioned by entity DHCP. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:16:06.083625 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:06.089556 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f629647e-91ee-4c48-8c54-cd33eb92544d tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:16:06.155816 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Network 83aff072-8820-4a36-b8f3-036a7011aace is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:16:06.158930 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:16:06.163296 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:16:06.198284 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event updated for resources: {'Port': ['ID=76ab4fe7-d435-44e6-8eac-07c05d50efc4,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:16:06.203130 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:16:06.238183 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:06.238183 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:06.346349 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-fa78aee5-dde5-494f-b53b-76c73f17e2a0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.0900812
Jun 01 10:16:06.358041 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Request body: {'port': {'device_id': '21a80279-3681-4303-b5c5-114fcc3aae4f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:16:06.449802 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-abe736b1-c21e-4d28-a70a-81722614e88a None None] Provisioning for port 76ab4fe7-d435-44e6-8eac-07c05d50efc4 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:16:06.454845 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-abe736b1-c21e-4d28-a70a-81722614e88a None None] Provisioning complete for port 76ab4fe7-d435-44e6-8eac-07c05d50efc4 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:16:06.455492 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-abe736b1-c21e-4d28-a70a-81722614e88a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:06.477340 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:06.527603 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-abe736b1-c21e-4d28-a70a-81722614e88a None None] Port 76ab4fe7-d435-44e6-8eac-07c05d50efc4 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:16:06.816198 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-563efaf0-cc90-40c8-971c-db35940de06a req-eef020f2-cc57-4e2a-8689-ef057462a940 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:06.816811 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-563efaf0-cc90-40c8-971c-db35940de06a req-eef020f2-cc57-4e2a-8689-ef057462a940 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Synchronizing usage tracker for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:16:06.918236 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 76ab4fe7-d435-44e6-8eac-07c05d50efc4 {{(pid=92566) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:16:06.925682 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:06.928418 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-563efaf0-cc90-40c8-971c-db35940de06a req-eef020f2-cc57-4e2a-8689-ef057462a940 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Unset dirty status for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:16:06.934778 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-563efaf0-cc90-40c8-971c-db35940de06a req-eef020f2-cc57-4e2a-8689-ef057462a940 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 931 time: 0.3026567
Jun 01 10:16:06.957364 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Transition to ACTIVE for port object 76ab4fe7-d435-44e6-8eac-07c05d50efc4 will not be triggered until provisioned by entity L2. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:16:06.982327 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-563efaf0-cc90-40c8-971c-db35940de06a req-eb7c936b-4222-4315-8d88-ab5473ba461f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0446553
Jun 01 10:16:07.003772 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:07.008446 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-c8d6bf82-4075-4341-90f5-087dbcecf0a3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:16:07.162820 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Pushing event updated for resources: {'Port': ['ID=76ab4fe7-d435-44e6-8eac-07c05d50efc4,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:16:07.170277 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:16:07.243215 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Attempting to bind port 76ab4fe7-d435-44e6-8eac-07c05d50efc4 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:16:07.243896 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Attempting to bind port 76ab4fe7-d435-44e6-8eac-07c05d50efc4 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:16:07.243896 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Attempting to bind port 76ab4fe7-d435-44e6-8eac-07c05d50efc4 on network 83aff072-8820-4a36-b8f3-036a7011aace {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:16:07.248416 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Port 76ab4fe7-d435-44e6-8eac-07c05d50efc4 on network 83aff072-8820-4a36-b8f3-036a7011aace not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:16:07.248730 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Attempting to bind port 76ab4fe7-d435-44e6-8eac-07c05d50efc4 on network 83aff072-8820-4a36-b8f3-036a7011aace {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:16:07.253736 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 15, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:16:07.254072 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Checking segment: {'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:16:07.255159 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Bound using segment: {'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:16:07.255159 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Bound port: 76ab4fe7-d435-44e6-8eac-07c05d50efc4, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace'}}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:16:07.255916 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:07.347574 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] For port 76ab4fe7-d435-44e6-8eac-07c05d50efc4, host hv-cinder-78726, cleared binding levels {{(pid=92566) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:16:07.351139 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] For port 76ab4fe7-d435-44e6-8eac-07c05d50efc4, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=76ab4fe7-d435-44e6-8eac-07c05d50efc4,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92566) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:16:07.462045 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:07.466505 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1f2c18da-0b55-4656-82a1-aa95a667fff7 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:16:07.528921 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:07.529551 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:07.530995 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] 10.222.0.30 "PUT /v2.0/ports/76ab4fe7-d435-44e6-8eac-07c05d50efc4 HTTP/1.1" status: 200  len: 1093 time: 1.1769562
Jun 01 10:16:07.533690 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '21a80279-3681-4303-b5c5-114fcc3aae4f', 'tag': '76ab4fe7-d435-44e6-8eac-07c05d50efc4'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:16:07.536102 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-83274eb7-32bb-4925-8842-34f287d49c05" -d '{"events": [{"name": "network-changed", "server_uuid": "21a80279-3681-4303-b5c5-114fcc3aae4f", "tag": "76ab4fe7-d435-44e6-8eac-07c05d50efc4"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:16:07.552513 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Pushing event updated for resources: {'Port': ['ID=76ab4fe7-d435-44e6-8eac-07c05d50efc4,revision_number=3']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:16:07.556140 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:16:07.596160 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:16:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c6d5e742-4a9e-49be-aaf0-5085ad073f92 x-openstack-request-id: req-c6d5e742-4a9e-49be-aaf0-5085ad073f92 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:16:07.596489 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "21a80279-3681-4303-b5c5-114fcc3aae4f", "tag": "76ab4fe7-d435-44e6-8eac-07c05d50efc4", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:16:07.596775 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-c6d5e742-4a9e-49be-aaf0-5085ad073f92 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:16:07.597214 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '21a80279-3681-4303-b5c5-114fcc3aae4f', 'tag': '76ab4fe7-d435-44e6-8eac-07c05d50efc4', 'status': 'completed', 'code': 200}
Jun 01 10:16:07.714035 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83274eb7-32bb-4925-8842-34f287d49c05 req-0e6aedc2-12e3-47a2-9438-e01312a54580 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:07.715559 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-83274eb7-32bb-4925-8842-34f287d49c05 req-0e6aedc2-12e3-47a2-9438-e01312a54580 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 1096 time: 0.0943222
Jun 01 10:16:07.967505 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83274eb7-32bb-4925-8842-34f287d49c05 req-49e27e44-92c7-4dcb-b968-b2950cf0fad5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:07.969054 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-83274eb7-32bb-4925-8842-34f287d49c05 req-49e27e44-92c7-4dcb-b968-b2950cf0fad5 service neutron] 10.222.0.30 "GET /v2.0/networks?tenant_id=cfa9132b1ba044548228b96f6c2755eb&shared=False HTTP/1.1" status: 200  len: 910 time: 0.2449825
Jun 01 10:16:08.149197 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83274eb7-32bb-4925-8842-34f287d49c05 req-59144bcb-9ab4-436c-9ae4-64a84e79ff0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:08.150641 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-83274eb7-32bb-4925-8842-34f287d49c05 req-59144bcb-9ab4-436c-9ae4-64a84e79ff0c service neutron] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1743274
Jun 01 10:16:08.193163 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88f24c75-9030-4b55-9486-d71b243ade0d req-b03ec18a-08a3-4233-9225-f2b21ed2cc81 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:08.195266 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-88f24c75-9030-4b55-9486-d71b243ade0d req-b03ec18a-08a3-4233-9225-f2b21ed2cc81 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 943 time: 0.0998533
Jun 01 10:16:08.301293 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-88f24c75-9030-4b55-9486-d71b243ade0d req-5df79622-2f85-484f-9c74-1cc2f9ee3d2c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0588222
Jun 01 10:16:08.305533 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-998a545d-cefe-4b7f-83b4-2100d1b8c6be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:08.307152 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-998a545d-cefe-4b7f-83b4-2100d1b8c6be service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 1096 time: 0.1109917
Jun 01 10:16:08.381019 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-b7def5e2-d9e6-45af-a698-1e8e3eb7308c service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=76ab4fe7-d435-44e6-8eac-07c05d50efc4 HTTP/1.1" status: 200  len: 217 time: 0.0643404
Jun 01 10:16:08.443492 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-0c06e822-3d0f-4d69-b2eb-95d335b6aa69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:08.445486 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-0c06e822-3d0f-4d69-b2eb-95d335b6aa69 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=38dbf18a-9bde-4c4a-b149-d02ad12671d3 HTTP/1.1" status: 200  len: 848 time: 0.0579283
Jun 01 10:16:08.468349 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:16:08.522140 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-335c0946-a08f-429f-8cec-03c34e42e653 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:08.523663 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-335c0946-a08f-429f-8cec-03c34e42e653 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=83aff072-8820-4a36-b8f3-036a7011aace&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0702708
Jun 01 10:16:08.658969 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-a662e362-465e-4fa7-ab1d-02f3ad28e267 service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1282139
Jun 01 10:16:08.800654 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b1c14125-ef48-4a43-9efd-ed2e63f27416 req-555dc6e9-057d-47c5-a407-f33d7848c504 service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1345079
Jun 01 10:16:09.481921 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c6279f3-48d3-407d-95eb-a38a038a47dc req-5cf0795f-163c-4f96-8712-2479e83bbc68 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:09.483388 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5c6279f3-48d3-407d-95eb-a38a038a47dc req-5cf0795f-163c-4f96-8712-2479e83bbc68 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 943 time: 0.0870194
Jun 01 10:16:09.529797 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5c6279f3-48d3-407d-95eb-a38a038a47dc req-11280930-ad6a-4c30-837b-c29a63a5dedb tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0401709
Jun 01 10:16:10.483877 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-94e90a7b-bedf-4933-8321-78d2922b4a1f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:10.717637 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617ef4a9-84cc-4371-a232-0facc31f36b0 req-c5410fbe-7106-4048-9690-65137e04c608 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:10.719263 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-617ef4a9-84cc-4371-a232-0facc31f36b0 req-c5410fbe-7106-4048-9690-65137e04c608 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 943 time: 0.0830982
Jun 01 10:16:10.778486 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-617ef4a9-84cc-4371-a232-0facc31f36b0 req-2da92a7b-29e6-40ca-bea0-bca6e61daed3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0531070
Jun 01 10:16:11.969658 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f6df38c-8ae7-4c32-8440-8f0239be8a56 req-bc0135fd-e803-4b43-b4b6-313b3675d5f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:11.971160 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5f6df38c-8ae7-4c32-8440-8f0239be8a56 req-bc0135fd-e803-4b43-b4b6-313b3675d5f1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 943 time: 0.0796430
Jun 01 10:16:12.016000 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-5f6df38c-8ae7-4c32-8440-8f0239be8a56 req-be21b18a-d107-4a45-8abb-cae617fba6f4 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0382955
Jun 01 10:16:12.992584 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-919cb4bf-2979-4d69-9d4b-ebace7d94889 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:13.203381 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-303c17ff-a7c2-4630-8b59-8b1570fe0bf7 req-e12a7197-a77a-4dec-a47e-1e2be1278a1d tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:13.205260 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-303c17ff-a7c2-4630-8b59-8b1570fe0bf7 req-e12a7197-a77a-4dec-a47e-1e2be1278a1d tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 943 time: 0.0845950
Jun 01 10:16:13.249304 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-303c17ff-a7c2-4630-8b59-8b1570fe0bf7 req-b613672d-889c-4194-a2f1-a76fe6cf54a2 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0387897
Jun 01 10:16:13.289293 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:14.065128 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:14.430120 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc9c7de0-99e4-4b33-a570-e5a8aae2f28f req-f29c9b73-084b-409f-a986-a1c62bcc2a40 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:14.431557 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fc9c7de0-99e4-4b33-a570-e5a8aae2f28f req-f29c9b73-084b-409f-a986-a1c62bcc2a40 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 943 time: 0.0795591
Jun 01 10:16:14.475380 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-fc9c7de0-99e4-4b33-a570-e5a8aae2f28f req-8d2eab49-fb2c-4b11-8add-7192d316a145 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0382142
Jun 01 10:16:15.659010 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c9b04ca-a386-43ee-add4-270253aafd9a req-92f01bfa-ca6d-4e38-ad40-498579b3eb0b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:15.660466 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6c9b04ca-a386-43ee-add4-270253aafd9a req-92f01bfa-ca6d-4e38-ad40-498579b3eb0b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 943 time: 0.0836208
Jun 01 10:16:15.703882 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6c9b04ca-a386-43ee-add4-270253aafd9a req-4647ed84-189c-45ad-a496-d4d7b4a2090e tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0378020
Jun 01 10:16:15.802129 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:16.337533 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 76ab4fe7-d435-44e6-8eac-07c05d50efc4 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:16:16.480497 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 76ab4fe7-d435-44e6-8eac-07c05d50efc4, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=76ab4fe7-d435-44e6-8eac-07c05d50efc4,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:16:16.494433 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': '76ab4fe7-d435-44e6-8eac-07c05d50efc4', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'port_id': '76ab4fe7-d435-44e6-8eac-07c05d50efc4', 'mac_address': 'fa:16:3e:d3:4e:3a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 857, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:16:16.549101 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:16.566258 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 76ab4fe7-d435-44e6-8eac-07c05d50efc4 {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:16:16.582003 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 76ab4fe7-d435-44e6-8eac-07c05d50efc4, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=76ab4fe7-d435-44e6-8eac-07c05d50efc4,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:16:16.587067 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-cfe14197-2c49-4518-b37a-0f282b9544d7 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Synchronizing usage tracker for tenant:471ae02220fb428c836d64a2bb2bcb76 on resource:security_group {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:16:16.632234 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:16.634017 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:16:16.660841 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-cfe14197-2c49-4518-b37a-0f282b9544d7 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Unset dirty status for tenant:471ae02220fb428c836d64a2bb2bcb76 on resource:security_group {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:16:16.662019 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-cfe14197-2c49-4518-b37a-0f282b9544d7 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-924937826&fields=id&tenant_id=471ae02220fb428c836d64a2bb2bcb76 HTTP/1.1" status: 200  len: 267 time: 0.1162143
Jun 01 10:16:16.702577 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=76ab4fe7-d435-44e6-8eac-07c05d50efc4,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:16:16.705686 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:16:16.820491 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-d4f71e48-801e-409d-83da-30fde54b5b7c tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:16.821914 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-d4f71e48-801e-409d-83da-30fde54b5b7c tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/networks?id=5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 HTTP/1.1" status: 200  len: 809 time: 0.1520197
Jun 01 10:16:16.878152 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['76ab4fe7-d435-44e6-8eac-07c05d50efc4'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:16:16.967417 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-e2cecbdc-0f93-4530-8030-a475ee42e0d5 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/quotas/471ae02220fb428c836d64a2bb2bcb76 HTTP/1.1" status: 200  len: 375 time: 0.1163898
Jun 01 10:16:17.064503 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088de4ec-99cf-451d-a83c-e531f44c13b2 req-8ad1b0d7-6591-41f6-ae3e-36b14a3a0674 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:17.065980 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-088de4ec-99cf-451d-a83c-e531f44c13b2 req-8ad1b0d7-6591-41f6-ae3e-36b14a3a0674 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 944 time: 0.2531424
Jun 01 10:16:17.093061 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-d0f9308c-8893-42ca-bcbb-b179ddceab04 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?tenant_id=471ae02220fb428c836d64a2bb2bcb76&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1163683
Jun 01 10:16:17.189506 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-088de4ec-99cf-451d-a83c-e531f44c13b2 req-4d289239-b0c4-44c9-98f5-f2fccb251458 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1155422
Jun 01 10:16:17.246698 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-4d1b6470-fea2-420c-95bc-7f280bb9d364 service neutron] 10.222.0.68 "GET /v2.0/networks/5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1357672
Jun 01 10:16:17.379824 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-3d41c058-2542-4431-bc87-ef1d94c32adb service neutron] 10.222.0.68 "GET /v2.0/networks/5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1272998
Jun 01 10:16:18.050306 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4cdef68e-d422-4764-b333-396f1b9b7c22 req-cd4a476f-bb9e-4910-9a1e-80ecdaea5a96 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 210 time: 0.0464704
Jun 01 10:16:18.336741 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 76ab4fe7-d435-44e6-8eac-07c05d50efc4 up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:16:18.374541 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-317df984-a6cd-4de7-b769-f642f7902dee req-05dd8b02-2b1d-4c83-ad0c-d993482d61ba tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:18.376051 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-317df984-a6cd-4de7-b769-f642f7902dee req-05dd8b02-2b1d-4c83-ad0c-d993482d61ba tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 944 time: 0.0815351
Jun 01 10:16:18.421799 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-317df984-a6cd-4de7-b769-f642f7902dee req-f082d668-a547-41d9-bd5f-3965f0766772 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0396118
Jun 01 10:16:18.500943 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port 76ab4fe7-d435-44e6-8eac-07c05d50efc4 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:16:18.506180 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port 76ab4fe7-d435-44e6-8eac-07c05d50efc4 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:16:18.506555 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:18.624180 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:18.650595 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '21a80279-3681-4303-b5c5-114fcc3aae4f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '76ab4fe7-d435-44e6-8eac-07c05d50efc4'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:16:18.652865 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6c73b9e6-6308-424f-b367-9847445e43db" -d '{"events": [{"server_uuid": "21a80279-3681-4303-b5c5-114fcc3aae4f", "name": "network-vif-plugged", "status": "completed", "tag": "76ab4fe7-d435-44e6-8eac-07c05d50efc4"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:16:18.660915 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port 76ab4fe7-d435-44e6-8eac-07c05d50efc4, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=76ab4fe7-d435-44e6-8eac-07c05d50efc4,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:16:18.695343 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:16:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6f1655a0-4374-4b3f-b35e-b91859223a6b x-openstack-request-id: req-6f1655a0-4374-4b3f-b35e-b91859223a6b {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:16:18.695343 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "21a80279-3681-4303-b5c5-114fcc3aae4f", "name": "network-vif-plugged", "status": "completed", "tag": "76ab4fe7-d435-44e6-8eac-07c05d50efc4", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:16:18.695343 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-6f1655a0-4374-4b3f-b35e-b91859223a6b {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:16:18.695673 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '21a80279-3681-4303-b5c5-114fcc3aae4f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '76ab4fe7-d435-44e6-8eac-07c05d50efc4', 'code': 200}
Jun 01 10:16:18.753008 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:18.754919 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8247d317-07c6-4d44-a5c3-b74a26dc8369 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:16:18.833534 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=76ab4fe7-d435-44e6-8eac-07c05d50efc4,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:16:18.838892 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:18.839264 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:18.839607 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:18.839937 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:18.840262 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:18.840588 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:18.840908 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:18.841229 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:18.841552 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:18.841871 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:18.842189 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:18.842505 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:18.846337 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:16:19.152266 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-1bb54e16-f9d9-4abd-ab97-426a0301ab9b req-945c7045-71ff-4c0f-9002-2f0973a6c941 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 210 time: 0.0495965
Jun 01 10:16:19.228049 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73708306-6a33-47e6-95ff-3c2e29b1fad1 req-f3d31893-a4a6-4827-8f70-83800f224f12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:19.229667 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-73708306-6a33-47e6-95ff-3c2e29b1fad1 req-f3d31893-a4a6-4827-8f70-83800f224f12 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 1098 time: 0.0688326
Jun 01 10:16:19.274528 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-73708306-6a33-47e6-95ff-3c2e29b1fad1 req-e42aa114-ec45-4b0f-b2a8-12a591d4d7b2 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0343828
Jun 01 10:16:19.612225 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e09df6e-6b7b-4b0e-8a2a-ca042edd6186 req-206cb9ed-d516-4c97-b56f-bfea3d948dc1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:19.613926 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8e09df6e-6b7b-4b0e-8a2a-ca042edd6186 req-206cb9ed-d516-4c97-b56f-bfea3d948dc1 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 945 time: 0.0841479
Jun 01 10:16:19.659563 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8e09df6e-6b7b-4b0e-8a2a-ca042edd6186 req-48a766b3-c720-4ec1-97ac-366902d5dea6 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390985
Jun 01 10:16:20.311173 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f1bf5158-3885-4890-9d0e-d26721bb58e3 req-aefe33c6-ee64-40b8-bd26-d53c042fcc1c tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 210 time: 0.0449851
Jun 01 10:16:20.646075 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-639e40bf-eb36-4612-b22a-a0903040133d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:20.647447 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-639e40bf-eb36-4612-b22a-a0903040133d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.30 "GET /v2.0/networks?id=5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 HTTP/1.1" status: 200  len: 809 time: 0.1626902
Jun 01 10:16:20.700851 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-6353333f-8a7e-4553-91f6-f978ba9995aa tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.30 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=471ae02220fb428c836d64a2bb2bcb76 HTTP/1.1" status: 200  len: 379 time: 0.0405498
Jun 01 10:16:20.709586 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Request body: {'port': {'device_id': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'admin_state_up': True, 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'security_groups': ['9c0d5e08-f5eb-42aa-9a8f-dc89327e470c']}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:16:20.903269 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:16:20.908872 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Usage tracker for resource:port and tenant:471ae02220fb428c836d64a2bb2bcb76 is out of sync, need to count used quota {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:16:20.912155 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Quota usage for port was recalculated. Used quota:2. {{(pid=92566) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:16:20.919381 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.quota.driver [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=92566) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:16:20.936371 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e62869b2-b39c-46cc-988b-b27c56950b06 req-d5fc9e93-4e2a-4595-b079-3e40770fb455 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:20.937874 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e62869b2-b39c-46cc-988b-b27c56950b06 req-d5fc9e93-4e2a-4595-b079-3e40770fb455 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 945 time: 0.1559649
Jun 01 10:16:20.984282 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e62869b2-b39c-46cc-988b-b27c56950b06 req-39ea5bab-48ae-4d3b-9c51-7c1325be0691 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0403731
Jun 01 10:16:21.019089 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Made reservation on behalf of 471ae02220fb428c836d64a2bb2bcb76 for: {'port': 1} {{(pid=92566) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 10:16:21.022773 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:21.245458 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.db_base_plugin_common [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Allocated IP 172.20.0.12 (5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9/24404399-0c0c-45bf-839e-f86b0f5c30d7/a7c8635b-7446-4fde-9653-ce439be1b0e2) {{(pid=92566) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:16:21.257283 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dc64ee8-d382-46a3-865a-731e06b3456e req-841139e3-be5b-44af-9f29-8c5c4a48b7a4 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:21.262536 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2dc64ee8-d382-46a3-865a-731e06b3456e req-841139e3-be5b-44af-9f29-8c5c4a48b7a4 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 945 time: 0.1650491
Jun 01 10:16:21.338292 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2dc64ee8-d382-46a3-865a-731e06b3456e req-2d97b3a7-e5a4-4bec-969f-a3454a0cc140 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0731580
Jun 01 10:16:21.362471 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40158) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:16:21.554471 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a58db62-5f3d-4db9-b722-b4229cdba262 tempest-TestVolumeBootPattern-1204700571 tempest-TestVolumeBootPattern-1204700571-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:21.556098 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-2a58db62-5f3d-4db9-b722-b4229cdba262 tempest-TestVolumeBootPattern-1204700571 tempest-TestVolumeBootPattern-1204700571-project-admin] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 1093 time: 0.1916506
Jun 01 10:16:21.559454 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40164) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:16:21.564657 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Request body: {'floatingip': {'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'port_id': '76ab4fe7-d435-44e6-8eac-07c05d50efc4', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address': '172.20.0.6'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:16:21.571149 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:16:21.575700 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Usage tracker for resource:floatingip and tenant:cfa9132b1ba044548228b96f6c2755eb is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:16:21.578622 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:16:21.583053 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4c6c4c74-c730-418f-a275-6b6c06e7dc27 req-57fd7b44-814f-4177-a605-ed52b27f6631 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 210 time: 0.1527631
Jun 01 10:16:21.589763 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:16:21.638012 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for port, precommit_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:21.653740 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Transition to ACTIVE for port object a7c8635b-7446-4fde-9653-ce439be1b0e2 will not be triggered until provisioned by entity DHCP. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:16:21.689297 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for floatingip, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:21.741509 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_create {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:21.751159 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-908ae328-2433-434c-b1e3-fcba2b83d570 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:16:21.820382 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Network 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 is already hosted by enough agents. {{(pid=92566) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:16:21.824124 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.base_scheduler [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Resources bound (agent type, host, resource id):  {{(pid=92566) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:16:21.826809 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Received port after_create {{(pid=92566) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:16:21.836398 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:21.880350 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Pushing event updated for resources: {'Port': ['ID=a7c8635b-7446-4fde-9653-ce439be1b0e2,revision_number=1']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:16:21.884105 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:16:21.913990 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:21.914679 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:21.990761 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Allocated IP 172.27.2.5 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/07f04f4e-e436-4366-bd86-313984214891) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:16:22.010446 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.30 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.3043873
Jun 01 10:16:22.022159 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-151b19c0-3eba-43dc-92d3-e72812924200 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] http://10.222.0.68:9696/v2.0/extensions returned with HTTP 200 {{(pid=92566) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 10:16:22.023740 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-151b19c0-3eba-43dc-92d3-e72812924200 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0068588
Jun 01 10:16:22.083257 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.v2.base [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Request body: {'port': {'device_id': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78726'}} {{(pid=92566) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:16:22.152252 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-3479e125-46f0-4fae-b8bc-b3ea51b73197 None None] Provisioning for port a7c8635b-7446-4fde-9653-ce439be1b0e2 completed by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:16:22.159179 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-3479e125-46f0-4fae-b8bc-b3ea51b73197 None None] Provisioning complete for port a7c8635b-7446-4fde-9653-ce439be1b0e2 triggered by entity DHCP. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:16:22.160109 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-3479e125-46f0-4fae-b8bc-b3ea51b73197 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:22.210746 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:22.224764 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-3479e125-46f0-4fae-b8bc-b3ea51b73197 None None] Port a7c8635b-7446-4fde-9653-ce439be1b0e2 cannot update to ACTIVE because it is not bound. {{(pid=92567) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 10:16:22.279209 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:22.426835 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:22.430668 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:16:22.494391 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:16:22.497918 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:16:22.501788 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:16:22.540747 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event updated for resources: {'Port': ['ID=07f04f4e-e436-4366-bd86-313984214891,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:16:22.545122 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:16:22.570756 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a7c8635b-7446-4fde-9653-ce439be1b0e2 {{(pid=92566) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:16:22.579122 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:22.599208 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.provisioning_blocks [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Transition to ACTIVE for port object a7c8635b-7446-4fde-9653-ce439be1b0e2 will not be triggered until provisioned by entity L2. {{(pid=92566) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 10:16:22.659395 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:22.664805 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f9632714-1bc0-47c3-b2e8-b632ab980565 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:16:22.881159 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Pushing event updated for resources: {'Port': ['ID=a7c8635b-7446-4fde-9653-ce439be1b0e2,revision_number=2']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:16:22.891070 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.226s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:16:22.937261 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:22.976440 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af549606-0f1f-47cf-bca8-0ebdc7a24a74 req-0a3e3948-22a4-4b73-b48a-8dab453372f1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:22.977138 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-af549606-0f1f-47cf-bca8-0ebdc7a24a74 req-0a3e3948-22a4-4b73-b48a-8dab453372f1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Synchronizing usage tracker for tenant:471ae02220fb428c836d64a2bb2bcb76 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:16:22.983332 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Attempting to bind port a7c8635b-7446-4fde-9653-ce439be1b0e2 on host hv-cinder-78726 for vnic_type normal with profile  {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 10:16:22.983672 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Attempting to bind port a7c8635b-7446-4fde-9653-ce439be1b0e2 by drivers openvswitch,hyperv on host hv-cinder-78726 at level 0 using segments [{'id': 'e26992f8-9861-4fb0-83e9-200e0276045e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9'}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 10:16:22.984005 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Attempting to bind port a7c8635b-7446-4fde-9653-ce439be1b0e2 on network 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:16:22.993102 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Port a7c8635b-7446-4fde-9653-ce439be1b0e2 on network 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78726 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 10:16:22.993427 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Attempting to bind port a7c8635b-7446-4fde-9653-ce439be1b0e2 on network 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 10:16:23.002465 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Checking agent: {'id': '8630a40e-5627-4a4a-ac60-cdf3286e7fd6', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78726', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'started_at': datetime.datetime(2021, 6, 1, 10, 4, 26), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 10, 15, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 10:16:23.002742 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Checking segment: {'id': 'e26992f8-9861-4fb0-83e9-200e0276045e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=92566) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 10:16:23.003159 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Bound using segment: {'id': 'e26992f8-9861-4fb0-83e9-200e0276045e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9'} {{(pid=92566) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 10:16:23.003589 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.managers [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Bound port: a7c8635b-7446-4fde-9653-ce439be1b0e2, host: hv-cinder-78726, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e26992f8-9861-4fb0-83e9-200e0276045e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9'}}] {{(pid=92566) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 10:16:23.003940 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:23.062811 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:23.095372 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] For port a7c8635b-7446-4fde-9653-ce439be1b0e2, host hv-cinder-78726, cleared binding levels {{(pid=92566) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 10:16:23.098461 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] For port a7c8635b-7446-4fde-9653-ce439be1b0e2, host hv-cinder-78726, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=a7c8635b-7446-4fde-9653-ce439be1b0e2,segment=NetworkSegment(e26992f8-9861-4fb0-83e9-200e0276045e),segment_id=e26992f8-9861-4fb0-83e9-200e0276045e)] {{(pid=92566) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 10:16:23.117629 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-af549606-0f1f-47cf-bca8-0ebdc7a24a74 req-0a3e3948-22a4-4b73-b48a-8dab453372f1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Unset dirty status for tenant:471ae02220fb428c836d64a2bb2bcb76 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:16:23.119536 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-af549606-0f1f-47cf-bca8-0ebdc7a24a74 req-0a3e3948-22a4-4b73-b48a-8dab453372f1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 944 time: 0.4131062
Jun 01 10:16:23.163794 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-af549606-0f1f-47cf-bca8-0ebdc7a24a74 req-2a47144c-99e0-42d8-8b4c-053dc6efc4b0 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0392358
Jun 01 10:16:23.226642 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2757765'] for port, after_update {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:23.232105 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-1960db6f-0fc3-4ad4-890b-614d40592a5d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:16:23.270331 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:23.283512 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:23.283946 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:23.285517 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] 10.222.0.30 "PUT /v2.0/ports/a7c8635b-7446-4fde-9653-ce439be1b0e2 HTTP/1.1" status: 200  len: 1094 time: 1.2545574
Jun 01 10:16:23.294409 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'tag': 'a7c8635b-7446-4fde-9653-ce439be1b0e2'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:16:23.297428 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a80956b6-7877-40e6-a10b-0ed6dd716dd8" -d '{"events": [{"name": "network-changed", "server_uuid": "a86bd86c-a7bc-459a-9733-8b31623ad03c", "tag": "a7c8635b-7446-4fde-9653-ce439be1b0e2"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:16:23.323695 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Pushing event updated for resources: {'Port': ['ID=a7c8635b-7446-4fde-9653-ce439be1b0e2,revision_number=3']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:16:23.327922 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-59bf431b-454a-4cc0-9ce0-c2453e0dc6b3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:16:23.345455 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:16:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2f06e4e1-2193-48bc-88a3-20a865bbb2b7 x-openstack-request-id: req-2f06e4e1-2193-48bc-88a3-20a865bbb2b7 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:16:23.345455 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a86bd86c-a7bc-459a-9733-8b31623ad03c", "tag": "a7c8635b-7446-4fde-9653-ce439be1b0e2", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:16:23.345455 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-2f06e4e1-2193-48bc-88a3-20a865bbb2b7 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:16:23.345455 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'tag': 'a7c8635b-7446-4fde-9653-ce439be1b0e2', 'status': 'completed', 'code': 200}
Jun 01 10:16:23.369632 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2295697'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:23.373812 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-77674b7d-0ecc-422d-abdf-39b75e22c10e tempest-AttachVolumeNegativeTest-1321584352 tempest-AttachVolumeNegativeTest-1321584352-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:16:23.447200 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a80956b6-7877-40e6-a10b-0ed6dd716dd8 req-c19ff2b4-9147-464f-b5d4-7b400e963772 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:23.449361 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a80956b6-7877-40e6-a10b-0ed6dd716dd8 req-c19ff2b4-9147-464f-b5d4-7b400e963772 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=471ae02220fb428c836d64a2bb2bcb76&device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 1097 time: 0.0845730
Jun 01 10:16:23.487866 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event updated for resources: {'Port': ['ID=07f04f4e-e436-4366-bd86-313984214891,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:16:23.500429 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:23.556535 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:23.556741 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:23.557021 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:23.557417 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:23.557782 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:23.558143 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:23.558889 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:23.558889 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:23.559240 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:23.559596 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:23.559958 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:23.560307 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:16:23.571578 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:16:23.595583 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a80956b6-7877-40e6-a10b-0ed6dd716dd8 req-d46e4116-34d2-430f-a91c-649c0c818f0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:23.597038 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a80956b6-7877-40e6-a10b-0ed6dd716dd8 req-d46e4116-34d2-430f-a91c-649c0c818f0c service neutron] 10.222.0.30 "GET /v2.0/networks?tenant_id=471ae02220fb428c836d64a2bb2bcb76&shared=False HTTP/1.1" status: 200  len: 910 time: 0.1399198
Jun 01 10:16:23.681742 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.l3_db [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Floating IP c51de7d9-6100-4e87-af5a-d6af25067254 associated. External IP: 172.27.2.5, port: 76ab4fe7-d435-44e6-8eac-07c05d50efc4.
Jun 01 10:16:23.735724 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a80956b6-7877-40e6-a10b-0ed6dd716dd8 req-b2db184d-2865-4a5c-9f75-2c7edcf358c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:23.737173 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a80956b6-7877-40e6-a10b-0ed6dd716dd8 req-b2db184d-2865-4a5c-9f75-2c7edcf358c0 service neutron] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.1330450
Jun 01 10:16:23.945430 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-955d6899-3850-4b59-855e-0079637aec04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:23.946941 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-955d6899-3850-4b59-855e-0079637aec04 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=471ae02220fb428c836d64a2bb2bcb76&device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 1097 time: 0.1708789
Jun 01 10:16:24.017054 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-de92d15b-8445-4f76-acfc-78b42feef7b3 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a7c8635b-7446-4fde-9653-ce439be1b0e2 HTTP/1.1" status: 200  len: 217 time: 0.0616500
Jun 01 10:16:24.085626 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-cc9176a3-f4c0-48e6-bfe6-7a5fab7fff8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:24.087101 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-cc9176a3-f4c0-48e6-bfe6-7a5fab7fff8e service neutron] 10.222.0.30 "GET /v2.0/subnets?id=24404399-0c0c-45bf-839e-f86b0f5c30d7 HTTP/1.1" status: 200  len: 848 time: 0.0633821
Jun 01 10:16:24.154148 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Router 426524f6-17bf-45cb-b42b-2fec9e039ff0 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:16:24.162252 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-5c5ed290-a038-43f3-ba8b-bfdcfbd062f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:24.163933 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-5c5ed290-a038-43f3-ba8b-bfdcfbd062f7 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0704365
Jun 01 10:16:24.350458 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:16:24.360416 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-305c0298-1146-402a-9d9f-7ef09148b235 None None] Sync routers for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:16:24.364480 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-c26a0d2d-622b-4e79-96c0-a85d6fae01de service neutron] 10.222.0.30 "GET /v2.0/networks/5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1931593
Jun 01 10:16:24.370895 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-305c0298-1146-402a-9d9f-7ef09148b235 None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:16:24.372063 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-305c0298-1146-402a-9d9f-7ef09148b235 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe71ba7460>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:16:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:16:24.449894 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:24.473631 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29a5c156-494c-4e85-a373-1e3e4621beb2 req-244fb4b8-ead9-4686-a3d2-1460bee49945 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:24.475022 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-29a5c156-494c-4e85-a373-1e3e4621beb2 req-244fb4b8-ead9-4686-a3d2-1460bee49945 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 944 time: 0.1944680
Jun 01 10:16:24.519732 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 994 time: 2.9511330
Jun 01 10:16:24.519732 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '21a80279-3681-4303-b5c5-114fcc3aae4f', 'tag': '76ab4fe7-d435-44e6-8eac-07c05d50efc4'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:16:24.519732 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-62eba3f4-8047-4be3-a2e7-f11747142edf" -d '{"events": [{"name": "network-changed", "server_uuid": "21a80279-3681-4303-b5c5-114fcc3aae4f", "tag": "76ab4fe7-d435-44e6-8eac-07c05d50efc4"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:16:24.553640 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ffbbcfe-7942-4e21-8426-82c56caf49ad req-cc642b0d-6e0a-4f5c-afb7-294aa21fe29a service neutron] 10.222.0.30 "GET /v2.0/networks/5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1821058
Jun 01 10:16:24.561747 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:16:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-42e23403-aece-4df9-8191-8cbd3bc73ab9 x-openstack-request-id: req-42e23403-aece-4df9-8191-8cbd3bc73ab9 {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:16:24.562139 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "21a80279-3681-4303-b5c5-114fcc3aae4f", "tag": "76ab4fe7-d435-44e6-8eac-07c05d50efc4", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:16:24.562840 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-42e23403-aece-4df9-8191-8cbd3bc73ab9 {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:16:24.563362 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '21a80279-3681-4303-b5c5-114fcc3aae4f', 'tag': '76ab4fe7-d435-44e6-8eac-07c05d50efc4', 'status': 'completed', 'code': 200}
Jun 01 10:16:24.571721 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-29a5c156-494c-4e85-a373-1e3e4621beb2 req-6396c4f3-a5c8-4f9c-b81c-4bcbb148e153 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0777192
Jun 01 10:16:24.597431 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-305c0298-1146-402a-9d9f-7ef09148b235 None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:16:24.661684 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62eba3f4-8047-4be3-a2e7-f11747142edf req-3966771b-89a7-4e9e-9dce-a9e20ac0cbdb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:24.663216 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-62eba3f4-8047-4be3-a2e7-f11747142edf req-3966771b-89a7-4e9e-9dce-a9e20ac0cbdb service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 1098 time: 0.0744991
Jun 01 10:16:24.800724 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62eba3f4-8047-4be3-a2e7-f11747142edf req-09b310c2-48dc-4e9e-aaf8-9d40baf50521 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:24.802265 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-62eba3f4-8047-4be3-a2e7-f11747142edf req-09b310c2-48dc-4e9e-aaf8-9d40baf50521 service neutron] 10.222.0.30 "GET /v2.0/networks?id=83aff072-8820-4a36-b8f3-036a7011aace HTTP/1.1" status: 200  len: 910 time: 0.1327965
Jun 01 10:16:24.908448 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-62eba3f4-8047-4be3-a2e7-f11747142edf req-47b52aaf-c284-4d52-a7d2-eb66d14a84c1 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=76ab4fe7-d435-44e6-8eac-07c05d50efc4 HTTP/1.1" status: 200  len: 997 time: 0.0988934
Jun 01 10:16:24.952399 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-305c0298-1146-402a-9d9f-7ef09148b235 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe71ba7460>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '8dda3024-052e-4587-8448-6acdc53d117b', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'floating_ip_address': '172.27.2.28', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'port_id': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'mac_address': 'fa:16:3e:21:3e:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:14:01Z', 'updated_at': '2021-06-01T10:14:04Z', 'revision_number': 1, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address_scope': None}, {'id': 'c51de7d9-6100-4e87-af5a-d6af25067254', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'floating_ip_address': '172.27.2.5', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'port_id': '76ab4fe7-d435-44e6-8eac-07c05d50efc4', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 685, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'mac_address': 'fa:16:3e:d3:4e:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21a80279-3681-4303-b5c5-114fcc3aae4f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:16:22Z', 'updated_at': '2021-06-01T10:16:22Z', 'revision_number': 0, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:16:24.956120 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-305c0298-1146-402a-9d9f-7ef09148b235 None None] Checking router: 426524f6-17bf-45cb-b42b-2fec9e039ff0 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:16:24.964445 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-305c0298-1146-402a-9d9f-7ef09148b235 None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:16:24.965079 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-305c0298-1146-402a-9d9f-7ef09148b235 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe71ba7460>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:16:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:16:24.974165 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62eba3f4-8047-4be3-a2e7-f11747142edf req-a7fddd7a-f179-428d-8467-5fe93934457a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:24.975633 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-62eba3f4-8047-4be3-a2e7-f11747142edf req-a7fddd7a-f179-428d-8467-5fe93934457a service neutron] 10.222.0.30 "GET /v2.0/subnets?id=38dbf18a-9bde-4c4a-b149-d02ad12671d3 HTTP/1.1" status: 200  len: 848 time: 0.0608253
Jun 01 10:16:25.054478 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62eba3f4-8047-4be3-a2e7-f11747142edf req-cdff7576-1902-409c-9a27-02efb27d0e2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:25.055876 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-62eba3f4-8047-4be3-a2e7-f11747142edf req-cdff7576-1902-409c-9a27-02efb27d0e2b service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=83aff072-8820-4a36-b8f3-036a7011aace&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0704956
Jun 01 10:16:25.140750 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-305c0298-1146-402a-9d9f-7ef09148b235 None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:16:25.187170 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-62eba3f4-8047-4be3-a2e7-f11747142edf req-adae746c-157f-4118-b6d7-226849906b39 service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1247590
Jun 01 10:16:25.319608 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-62eba3f4-8047-4be3-a2e7-f11747142edf req-46146d6e-01b6-495f-b175-876aef961f3e service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1259301
Jun 01 10:16:25.494230 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-305c0298-1146-402a-9d9f-7ef09148b235 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe71ba7460>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '8dda3024-052e-4587-8448-6acdc53d117b', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'floating_ip_address': '172.27.2.28', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'port_id': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'mac_address': 'fa:16:3e:21:3e:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:14:01Z', 'updated_at': '2021-06-01T10:14:04Z', 'revision_number': 1, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address_scope': None}, {'id': 'c51de7d9-6100-4e87-af5a-d6af25067254', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'floating_ip_address': '172.27.2.5', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'port_id': '76ab4fe7-d435-44e6-8eac-07c05d50efc4', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 685, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'mac_address': 'fa:16:3e:d3:4e:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21a80279-3681-4303-b5c5-114fcc3aae4f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:16:22Z', 'updated_at': '2021-06-01T10:16:22Z', 'revision_number': 0, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:16:25.498159 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-305c0298-1146-402a-9d9f-7ef09148b235 None None] The sync data for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi is: [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '8dda3024-052e-4587-8448-6acdc53d117b', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'floating_ip_address': '172.27.2.28', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'port_id': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'mac_address': 'fa:16:3e:21:3e:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:14:01Z', 'updated_at': '2021-06-01T10:14:04Z', 'revision_number': 1, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address_scope': None}, {'id': 'c51de7d9-6100-4e87-af5a-d6af25067254', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'floating_ip_address': '172.27.2.5', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'port_id': '76ab4fe7-d435-44e6-8eac-07c05d50efc4', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 685, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'mac_address': 'fa:16:3e:d3:4e:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21a80279-3681-4303-b5c5-114fcc3aae4f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:16:22Z', 'updated_at': '2021-06-01T10:16:22Z', 'revision_number': 0, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:16:25.680299 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7469f2dd-8a92-41ef-bc1c-10895e72d751 None None] New status for floating IP c51de7d9-6100-4e87-af5a-d6af25067254: ACTIVE {{(pid=92568) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:16:25.766685 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72620b4a-9525-4635-bd62-22ab7878f48c req-6ca12408-390f-4c17-8153-1995f09d100c tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:25.768184 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-72620b4a-9525-4635-bd62-22ab7878f48c req-6ca12408-390f-4c17-8153-1995f09d100c tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 944 time: 0.0839617
Jun 01 10:16:25.816222 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-72620b4a-9525-4635-bd62-22ab7878f48c req-b372bb18-2c51-458e-af9b-9e8b49e3ded3 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0418520
Jun 01 10:16:26.592368 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:27.001451 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4777c3f7-2e53-4c6d-8749-5c56edb30664 req-0ba52468-cd76-4faf-8be8-9f458cf85b26 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:27.002930 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4777c3f7-2e53-4c6d-8749-5c56edb30664 req-0ba52468-cd76-4faf-8be8-9f458cf85b26 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 944 time: 0.0793893
Jun 01 10:16:27.047588 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4777c3f7-2e53-4c6d-8749-5c56edb30664 req-313f5b9a-b4c9-4319-ba28-91efbeaa5158 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390015
Jun 01 10:16:27.248607 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7ad9ceb3-1b29-482e-b7e5-480bb4891c34 req-b95009a9-9be7-4b69-9287-aeca3b2159ab service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0719175
Jun 01 10:16:27.477580 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ad9ceb3-1b29-482e-b7e5-480bb4891c34 req-5e154906-97a7-4010-843a-bfb50e014c74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:27.479071 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7ad9ceb3-1b29-482e-b7e5-480bb4891c34 req-5e154906-97a7-4010-843a-bfb50e014c74 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 1098 time: 0.1619573
Jun 01 10:16:27.621494 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ad9ceb3-1b29-482e-b7e5-480bb4891c34 req-78c59edb-e726-4963-bf1d-19b01b95c1a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:27.622840 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7ad9ceb3-1b29-482e-b7e5-480bb4891c34 req-78c59edb-e726-4963-bf1d-19b01b95c1a3 service neutron] 10.222.0.30 "GET /v2.0/networks?id=83aff072-8820-4a36-b8f3-036a7011aace HTTP/1.1" status: 200  len: 910 time: 0.1249626
Jun 01 10:16:27.726164 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7ad9ceb3-1b29-482e-b7e5-480bb4891c34 req-912480fd-1b56-4043-992d-e47a8c7a3e96 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea HTTP/1.1" status: 200  len: 1000 time: 0.0962493
Jun 01 10:16:27.789418 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ad9ceb3-1b29-482e-b7e5-480bb4891c34 req-3d2560d3-d9a9-4928-a72f-2a08f53af433 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:27.790866 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7ad9ceb3-1b29-482e-b7e5-480bb4891c34 req-3d2560d3-d9a9-4928-a72f-2a08f53af433 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=38dbf18a-9bde-4c4a-b149-d02ad12671d3 HTTP/1.1" status: 200  len: 848 time: 0.0586843
Jun 01 10:16:27.867880 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ad9ceb3-1b29-482e-b7e5-480bb4891c34 req-66220b92-48de-4760-ad1a-5e07b8073a17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:27.869325 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7ad9ceb3-1b29-482e-b7e5-480bb4891c34 req-66220b92-48de-4760-ad1a-5e07b8073a17 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=83aff072-8820-4a36-b8f3-036a7011aace&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0722930
Jun 01 10:16:27.999640 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7ad9ceb3-1b29-482e-b7e5-480bb4891c34 req-31efb4f0-36c5-441f-ae93-b29acb09c53a service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1236854
Jun 01 10:16:28.132880 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7ad9ceb3-1b29-482e-b7e5-480bb4891c34 req-cbb2b01d-a19c-400a-8483-9b2fd4cc94af service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1262748
Jun 01 10:16:28.226950 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2742843a-d6a0-48d9-988c-63f5a2d775aa req-7ae7dbcb-423d-4d17-a43e-4516d50cddfa tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:28.228410 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2742843a-d6a0-48d9-988c-63f5a2d775aa req-7ae7dbcb-423d-4d17-a43e-4516d50cddfa tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 944 time: 0.0786664
Jun 01 10:16:28.272557 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2742843a-d6a0-48d9-988c-63f5a2d775aa req-6972a001-de08-4064-b281-cbaff4b7b2e8 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0379343
Jun 01 10:16:29.463194 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e0fc900-c03c-4754-95bc-d36d38af5163 req-0f458927-479f-4317-ba97-7ff597311be9 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:29.464694 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2e0fc900-c03c-4754-95bc-d36d38af5163 req-0f458927-479f-4317-ba97-7ff597311be9 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 944 time: 0.0856397
Jun 01 10:16:29.509560 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2e0fc900-c03c-4754-95bc-d36d38af5163 req-3d6e261d-262f-4545-afd1-589d591a6c25 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391250
Jun 01 10:16:30.691799 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be7e8949-6765-4e4b-b1ad-bf60db31befb req-3038a7dc-23a1-4566-b9c5-e6147f9e174c tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:30.693229 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-be7e8949-6765-4e4b-b1ad-bf60db31befb req-3038a7dc-23a1-4566-b9c5-e6147f9e174c tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 944 time: 0.0783093
Jun 01 10:16:30.740394 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-be7e8949-6765-4e4b-b1ad-bf60db31befb req-3f395c6a-6831-4a1e-99a4-afb4174eefee tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416057
Jun 01 10:16:31.921101 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19fadd09-b8a4-41ac-92a4-a4f33c7cde5a req-e5f7c77f-4030-442e-8e37-ad9dd1002213 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:31.922561 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-19fadd09-b8a4-41ac-92a4-a4f33c7cde5a req-e5f7c77f-4030-442e-8e37-ad9dd1002213 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 944 time: 0.0793366
Jun 01 10:16:31.969509 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-19fadd09-b8a4-41ac-92a4-a4f33c7cde5a req-c10469ff-6e91-4269-96f8-a9915d8ed69e tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0411894
Jun 01 10:16:32.405253 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device a7c8635b-7446-4fde-9653-ce439be1b0e2 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:16:32.537690 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port a7c8635b-7446-4fde-9653-ce439be1b0e2, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=a7c8635b-7446-4fde-9653-ce439be1b0e2,segment=NetworkSegment(e26992f8-9861-4fb0-83e9-200e0276045e),segment_id=e26992f8-9861-4fb0-83e9-200e0276045e)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:16:32.550878 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': 'a7c8635b-7446-4fde-9653-ce439be1b0e2', 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'port_id': 'a7c8635b-7446-4fde-9653-ce439be1b0e2', 'mac_address': 'fa:16:3e:e4:c5:50', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 895, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:16:32.609110 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:32.625673 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a7c8635b-7446-4fde-9653-ce439be1b0e2 {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:16:32.640594 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port a7c8635b-7446-4fde-9653-ce439be1b0e2, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=a7c8635b-7446-4fde-9653-ce439be1b0e2,segment=NetworkSegment(e26992f8-9861-4fb0-83e9-200e0276045e),segment_id=e26992f8-9861-4fb0-83e9-200e0276045e)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:16:32.729328 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:32.733363 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:16:32.798988 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=a7c8635b-7446-4fde-9653-ce439be1b0e2,revision_number=4']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:16:32.803131 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:16:33.008441 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['a7c8635b-7446-4fde-9653-ce439be1b0e2'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:16:33.153946 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afb97431-aa85-4d29-9899-561922f950b7 req-4e4fd4bc-eb4e-4f91-a48a-7df90db6568f tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:33.155414 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-afb97431-aa85-4d29-9899-561922f950b7 req-4e4fd4bc-eb4e-4f91-a48a-7df90db6568f tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 945 time: 0.0830948
Jun 01 10:16:33.198419 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-afb97431-aa85-4d29-9899-561922f950b7 req-72d19850-ff4c-4de3-9739-eaf042c5363a tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0373216
Jun 01 10:16:34.390215 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc346416-c2f1-4d10-86ef-443b86f2545b req-89b020aa-7c48-478a-a5fc-9c9e9f481fc5 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:34.391687 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bc346416-c2f1-4d10-86ef-443b86f2545b req-89b020aa-7c48-478a-a5fc-9c9e9f481fc5 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 945 time: 0.0840516
Jun 01 10:16:34.421715 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device a7c8635b-7446-4fde-9653-ce439be1b0e2 up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:16:34.436418 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-bc346416-c2f1-4d10-86ef-443b86f2545b req-8545e829-4932-4be5-bfea-c593bbbe089d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390275
Jun 01 10:16:34.590451 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning for port a7c8635b-7446-4fde-9653-ce439be1b0e2 completed by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 10:16:34.595696 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port a7c8635b-7446-4fde-9653-ce439be1b0e2 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:16:34.596069 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:34.708419 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:34.735005 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a7c8635b-7446-4fde-9653-ce439be1b0e2'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:16:34.737199 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b7a0915-1004-46fc-88f5-65d1405e9de6" -d '{"events": [{"server_uuid": "a86bd86c-a7bc-459a-9733-8b31623ad03c", "name": "network-vif-plugged", "status": "completed", "tag": "a7c8635b-7446-4fde-9653-ce439be1b0e2"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:16:34.744883 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port a7c8635b-7446-4fde-9653-ce439be1b0e2, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=a7c8635b-7446-4fde-9653-ce439be1b0e2,segment=NetworkSegment(e26992f8-9861-4fb0-83e9-200e0276045e),segment_id=e26992f8-9861-4fb0-83e9-200e0276045e)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:16:34.779583 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:16:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9b5eef61-1304-414b-b211-4a2f3ddc7cf1 x-openstack-request-id: req-9b5eef61-1304-414b-b211-4a2f3ddc7cf1 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:16:34.779890 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a86bd86c-a7bc-459a-9733-8b31623ad03c", "name": "network-vif-plugged", "status": "completed", "tag": "a7c8635b-7446-4fde-9653-ce439be1b0e2", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:16:34.780127 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-9b5eef61-1304-414b-b211-4a2f3ddc7cf1 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:16:34.780550 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a7c8635b-7446-4fde-9653-ce439be1b0e2', 'code': 200}
Jun 01 10:16:34.808022 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:34.810262 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:16:34.877687 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=a7c8635b-7446-4fde-9653-ce439be1b0e2,revision_number=5']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:16:34.880572 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:16:35.210117 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f258fb0-8f1a-4939-bbf1-18001cfc36d1 req-9841708c-e7ac-4aa7-895c-8da7e1858ca2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:35.211579 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9f258fb0-8f1a-4939-bbf1-18001cfc36d1 req-9841708c-e7ac-4aa7-895c-8da7e1858ca2 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 1099 time: 0.0724277
Jun 01 10:16:35.252812 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9f258fb0-8f1a-4939-bbf1-18001cfc36d1 req-715aea82-539f-4947-a626-a5aa768e1a2b service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0339160
Jun 01 10:16:35.620560 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8f248a1-6ce1-4a79-b6e5-815e8da2720c req-43a7d89a-ad24-41de-889d-0f5c46ad4a27 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:35.622040 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f8f248a1-6ce1-4a79-b6e5-815e8da2720c req-43a7d89a-ad24-41de-889d-0f5c46ad4a27 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0799561
Jun 01 10:16:35.668344 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f8f248a1-6ce1-4a79-b6e5-815e8da2720c req-49bad8d4-5157-49ae-8d38-d0d1a6248eb7 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0407045
Jun 01 10:16:36.849872 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e7a9aea-8d5c-4849-b7f0-f508e16a78fc req-7c22a7cd-65e0-4a03-a87a-020b4114d6bb tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:36.851320 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6e7a9aea-8d5c-4849-b7f0-f508e16a78fc req-7c22a7cd-65e0-4a03-a87a-020b4114d6bb tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0782306
Jun 01 10:16:36.896719 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6e7a9aea-8d5c-4849-b7f0-f508e16a78fc req-70d59063-c1b4-4005-bfdb-a28c3540a41a tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0392621
Jun 01 10:16:37.079404 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a4d0f13-9165-4d72-b183-59167628176b req-7e91c5c1-4e55-46dd-84a6-4469c847a9e6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:37.080765 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6a4d0f13-9165-4d72-b183-59167628176b req-7e91c5c1-4e55-46dd-84a6-4469c847a9e6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0826256
Jun 01 10:16:37.208604 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6a4d0f13-9165-4d72-b183-59167628176b req-7d56cdc2-62bf-43c7-a653-c13b789d3b26 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1222584
Jun 01 10:16:37.232108 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40206) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:16:37.341321 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78436b8a-5bfe-4aff-8ade-d851b39aadbc tempest-TestShelveInstance-1338776872 tempest-TestShelveInstance-1338776872-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92565) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:37.341977 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-78436b8a-5bfe-4aff-8ade-d851b39aadbc tempest-TestShelveInstance-1338776872 tempest-TestShelveInstance-1338776872-project-admin] Synchronizing usage tracker for tenant:2a47e8f3f9e145ef9f900fd364b8d69e on resource:port {{(pid=92565) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:16:37.432947 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-78436b8a-5bfe-4aff-8ade-d851b39aadbc tempest-TestShelveInstance-1338776872 tempest-TestShelveInstance-1338776872-project-admin] Unset dirty status for tenant:2a47e8f3f9e145ef9f900fd364b8d69e on resource:port {{(pid=92565) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:16:37.434117 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-78436b8a-5bfe-4aff-8ade-d851b39aadbc tempest-TestShelveInstance-1338776872 tempest-TestShelveInstance-1338776872-project-admin] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 1094 time: 0.2010396
Jun 01 10:16:37.437052 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40212) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:16:37.441982 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.v2.base [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Request body: {'floatingip': {'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'port_id': 'a7c8635b-7446-4fde-9653-ce439be1b0e2', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'fixed_ip_address': '172.20.0.12'}} {{(pid=92565) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 10:16:37.447899 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 10:16:37.452155 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Usage tracker for resource:floatingip and tenant:471ae02220fb428c836d64a2bb2bcb76 is out of sync, need to count used quota {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 10:16:37.454994 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.quota.resource [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=92565) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 10:16:37.460717 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.quota.driver [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=92565) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 10:16:37.530136 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for floatingip, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:37.668419 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:37.806773 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_common [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Allocated IP 172.27.2.211 (a961b732-0873-4e86-af5a-7e84ae1a2549/0acb7e18-8599-43e3-af85-b85c21da308c/2b820418-9b14-4441-bd23-7d11c9d0a5e3) {{(pid=92565) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 10:16:37.951909 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for port, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:38.037675 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726957849811', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:38.042127 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-9be93e9d-2f7f-429c-b9a4-53f0e08a9eb0 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:16:38.104898 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Network a961b732-0873-4e86-af5a-7e84ae1a2549 is already hosted by enough agents. {{(pid=92565) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 10:16:38.108369 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.base_scheduler [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Resources bound (agent type, host, resource id):  {{(pid=92565) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 10:16:38.112089 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Received port after_create {{(pid=92565) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 10:16:38.147096 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Pushing event updated for resources: {'Port': ['ID=2b820418-9b14-4441-bd23-7d11c9d0a5e3,revision_number=1']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:16:38.151294 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:16:38.527462 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for floatingip, precommit_create {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:38.678960 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:38.878018 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for port, precommit_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:38.957387 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2295697'] for port, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:38.961230 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-3484b3fd-a4cc-41d2-9120-125274ef3ca8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:16:39.170663 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Pushing event updated for resources: {'Port': ['ID=2b820418-9b14-4441-bd23-7d11c9d0a5e3,revision_number=2']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:16:39.174474 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:16:39.180917 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-403588'] for floatingip, after_update {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:39.351167 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.l3_db [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Floating IP 3b4b3cb8-6693-4b49-a498-ac7276af85e9 associated. External IP: 172.27.2.211, port: a7c8635b-7446-4fde-9653-ce439be1b0e2.
Jun 01 10:16:39.694170 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Router ab86be34-7347-42c9-9bdf-c507ef094164 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:16:39.875690 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:16:39.887259 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-619f9724-9317-47a5-b4ed-78665ab4a010 None None] Sync routers for ids ['ab86be34-7347-42c9-9bdf-c507ef094164'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:16:39.896740 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-619f9724-9317-47a5-b4ed-78665ab4a010 None None] Routers {'ab86be34-7347-42c9-9bdf-c507ef094164'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:16:39.897359 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-619f9724-9317-47a5-b4ed-78665ab4a010 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe725b7fd0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:16:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['ab86be34-7347-42c9-9bdf-c507ef094164'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:16:39.963408 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:40.019122 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 2.5810258
Jun 01 10:16:40.019789 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'tag': 'a7c8635b-7446-4fde-9653-ce439be1b0e2'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:16:40.022022 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-40f88753-656b-4cb9-aa9a-66b464a06b74" -d '{"events": [{"name": "network-changed", "server_uuid": "a86bd86c-a7bc-459a-9733-8b31623ad03c", "tag": "a7c8635b-7446-4fde-9653-ce439be1b0e2"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:16:40.066771 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:16:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-31181ab4-0953-4e99-869e-892b56cbf2b4 x-openstack-request-id: req-31181ab4-0953-4e99-869e-892b56cbf2b4 {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:16:40.066771 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a86bd86c-a7bc-459a-9733-8b31623ad03c", "tag": "a7c8635b-7446-4fde-9653-ce439be1b0e2", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:16:40.067103 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-31181ab4-0953-4e99-869e-892b56cbf2b4 {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:16:40.067504 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'tag': 'a7c8635b-7446-4fde-9653-ce439be1b0e2', 'status': 'completed', 'code': 200}
Jun 01 10:16:40.082446 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-619f9724-9317-47a5-b4ed-78665ab4a010 None None] Set router ab86be34-7347-42c9-9bdf-c507ef094164 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:16:40.168547 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40f88753-656b-4cb9-aa9a-66b464a06b74 req-67ac50f8-441b-4a7c-aced-c4f06710ae20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:40.170069 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-40f88753-656b-4cb9-aa9a-66b464a06b74 req-67ac50f8-441b-4a7c-aced-c4f06710ae20 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=471ae02220fb428c836d64a2bb2bcb76&device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 1099 time: 0.0727863
Jun 01 10:16:40.302941 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40f88753-656b-4cb9-aa9a-66b464a06b74 req-12ecd5e8-7fa6-48fd-8b14-317deec54b58 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:40.304394 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-40f88753-656b-4cb9-aa9a-66b464a06b74 req-12ecd5e8-7fa6-48fd-8b14-317deec54b58 service neutron] 10.222.0.30 "GET /v2.0/networks?id=5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 HTTP/1.1" status: 200  len: 910 time: 0.1271563
Jun 01 10:16:40.411317 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-40f88753-656b-4cb9-aa9a-66b464a06b74 req-2bdb8a83-676f-4c64-b2fe-21716748cd66 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a7c8635b-7446-4fde-9653-ce439be1b0e2 HTTP/1.1" status: 200  len: 1000 time: 0.0993469
Jun 01 10:16:40.441428 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-619f9724-9317-47a5-b4ed-78665ab4a010 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe725b7fd0>, [{'id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'name': 'tempest-TestShelveInstance-1091968561-router', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201'}], 'enable_snat': True}, 'gw_port_id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:39Z', 'updated_at': '2021-06-01T10:15:44Z', 'revision_number': 4, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'gw_port': {'id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:a2:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:40Z', 'updated_at': '2021-06-01T10:15:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '3b4b3cb8-6693-4b49-a498-ac7276af85e9', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'floating_ip_address': '172.27.2.211', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'port_id': 'a7c8635b-7446-4fde-9653-ce439be1b0e2', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'mac_address': 'fa:16:3e:e4:c5:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:16:38Z', 'updated_at': '2021-06-01T10:16:38Z', 'revision_number': 0, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8fb04901-ea66-4310-aa8b-846af9a44567', 'name': '', 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'mac_address': 'fa:16:3e:0c:31:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_interface', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:43Z', 'updated_at': '2021-06-01T10:15:50Z', 'revision_number': 5, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'subnets': [{'id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:16:40.445432 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-619f9724-9317-47a5-b4ed-78665ab4a010 None None] Checking router: ab86be34-7347-42c9-9bdf-c507ef094164 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:16:40.453797 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-619f9724-9317-47a5-b4ed-78665ab4a010 None None] Routers {'ab86be34-7347-42c9-9bdf-c507ef094164'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:16:40.454399 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-619f9724-9317-47a5-b4ed-78665ab4a010 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe725b7fd0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:16:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['ab86be34-7347-42c9-9bdf-c507ef094164'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:16:40.478733 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40f88753-656b-4cb9-aa9a-66b464a06b74 req-a41f95a1-aa88-4623-ab71-763fb1958aa1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:40.480194 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-40f88753-656b-4cb9-aa9a-66b464a06b74 req-a41f95a1-aa88-4623-ab71-763fb1958aa1 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=24404399-0c0c-45bf-839e-f86b0f5c30d7 HTTP/1.1" status: 200  len: 848 time: 0.0612626
Jun 01 10:16:40.511319 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-ef05951a-f68c-4232-bd92-4281921db8b1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:40.556790 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40f88753-656b-4cb9-aa9a-66b464a06b74 req-0224d553-1f41-4504-b73c-94aa58bbd46a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:16:40.558186 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-40f88753-656b-4cb9-aa9a-66b464a06b74 req-0224d553-1f41-4504-b73c-94aa58bbd46a service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0710926
Jun 01 10:16:40.636716 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-619f9724-9317-47a5-b4ed-78665ab4a010 None None] Set router ab86be34-7347-42c9-9bdf-c507ef094164 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:16:40.692139 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-40f88753-656b-4cb9-aa9a-66b464a06b74 req-35eef515-d272-4c4e-94d2-ded5b0889c50 service neutron] 10.222.0.30 "GET /v2.0/networks/5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1261399
Jun 01 10:16:40.825315 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-40f88753-656b-4cb9-aa9a-66b464a06b74 req-eef374d7-23a2-4143-b49e-ebeefae7509a service neutron] 10.222.0.30 "GET /v2.0/networks/5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1241508
Jun 01 10:16:40.983143 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-619f9724-9317-47a5-b4ed-78665ab4a010 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe725b7fd0>, [{'id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'name': 'tempest-TestShelveInstance-1091968561-router', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201'}], 'enable_snat': True}, 'gw_port_id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:39Z', 'updated_at': '2021-06-01T10:15:44Z', 'revision_number': 4, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'gw_port': {'id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:a2:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:40Z', 'updated_at': '2021-06-01T10:15:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '3b4b3cb8-6693-4b49-a498-ac7276af85e9', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'floating_ip_address': '172.27.2.211', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'port_id': 'a7c8635b-7446-4fde-9653-ce439be1b0e2', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'mac_address': 'fa:16:3e:e4:c5:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:16:38Z', 'updated_at': '2021-06-01T10:16:38Z', 'revision_number': 0, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8fb04901-ea66-4310-aa8b-846af9a44567', 'name': '', 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'mac_address': 'fa:16:3e:0c:31:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_interface', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:43Z', 'updated_at': '2021-06-01T10:15:50Z', 'revision_number': 5, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'subnets': [{'id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:16:40.987016 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-619f9724-9317-47a5-b4ed-78665ab4a010 None None] The sync data for ids ['ab86be34-7347-42c9-9bdf-c507ef094164'] in dv-cinder-787262-4-iscsi is: [{'id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'name': 'tempest-TestShelveInstance-1091968561-router', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201'}], 'enable_snat': True}, 'gw_port_id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:39Z', 'updated_at': '2021-06-01T10:15:44Z', 'revision_number': 4, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'gw_port': {'id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:a2:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:40Z', 'updated_at': '2021-06-01T10:15:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '3b4b3cb8-6693-4b49-a498-ac7276af85e9', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'floating_ip_address': '172.27.2.211', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'port_id': 'a7c8635b-7446-4fde-9653-ce439be1b0e2', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'mac_address': 'fa:16:3e:e4:c5:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:16:38Z', 'updated_at': '2021-06-01T10:16:38Z', 'revision_number': 0, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8fb04901-ea66-4310-aa8b-846af9a44567', 'name': '', 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'mac_address': 'fa:16:3e:0c:31:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_interface', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:43Z', 'updated_at': '2021-06-01T10:15:50Z', 'revision_number': 5, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'subnets': [{'id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:16:41.158808 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4eed9aed-b432-437b-b657-ead758261ad2 None None] New status for floating IP 3b4b3cb8-6693-4b49-a498-ac7276af85e9: ACTIVE {{(pid=92568) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:16:42.952121 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-cd697bfe-5d5d-47d4-b449-91445bc3b391 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:43.253642 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:44.049134 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:45.467264 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:16:45.859119 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:16:56.556081 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:10.482777 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-d0e2a44d-43c2-434b-ac9b-ccd286b81ff8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:12.928678 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7692be5d-6d42-49a7-aa9d-4c231a5868aa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:13.265622 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:14.025984 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:15.808860 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:22.467340 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:17:26.574663 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:27.269846 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0c149604-3821-40a1-9442-74070d073910 req-f0affa11-a2c0-49a0-8b94-d4130698edbb service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0676436
Jun 01 10:17:27.365811 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c149604-3821-40a1-9442-74070d073910 req-bdae3a4c-3848-431d-859c-80eebfa89475 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:17:27.367276 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0c149604-3821-40a1-9442-74070d073910 req-bdae3a4c-3848-431d-859c-80eebfa89475 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 1098 time: 0.0723462
Jun 01 10:17:27.512948 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c149604-3821-40a1-9442-74070d073910 req-5b506b66-1342-431a-9f44-0e4dad710734 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:17:27.518086 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0c149604-3821-40a1-9442-74070d073910 req-5b506b66-1342-431a-9f44-0e4dad710734 service neutron] 10.222.0.30 "GET /v2.0/networks?id=83aff072-8820-4a36-b8f3-036a7011aace HTTP/1.1" status: 200  len: 910 time: 0.1240702
Jun 01 10:17:27.625627 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0c149604-3821-40a1-9442-74070d073910 req-3b67509f-c5be-45cd-9adb-ce7576abf36f service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=76ab4fe7-d435-44e6-8eac-07c05d50efc4 HTTP/1.1" status: 200  len: 999 time: 0.1001804
Jun 01 10:17:27.692736 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c149604-3821-40a1-9442-74070d073910 req-3534efd4-f5aa-449a-b474-4381e825d297 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:17:27.694144 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0c149604-3821-40a1-9442-74070d073910 req-3534efd4-f5aa-449a-b474-4381e825d297 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=38dbf18a-9bde-4c4a-b149-d02ad12671d3 HTTP/1.1" status: 200  len: 848 time: 0.0582626
Jun 01 10:17:27.776626 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c149604-3821-40a1-9442-74070d073910 req-f8941b6c-72cb-4fc9-8798-a666f63799a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:17:27.778091 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0c149604-3821-40a1-9442-74070d073910 req-f8941b6c-72cb-4fc9-8798-a666f63799a4 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=83aff072-8820-4a36-b8f3-036a7011aace&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0740833
Jun 01 10:17:27.915900 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0c149604-3821-40a1-9442-74070d073910 req-92384b7b-9db9-4faf-a3d9-5f29f276fbbe service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1253464
Jun 01 10:17:28.049529 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0c149604-3821-40a1-9442-74070d073910 req-f9ffe700-e767-4ea0-bd22-1046bc30743d service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1241767
Jun 01 10:17:40.504402 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-69fa4d0a-d4c7-4615-961d-da57e8a4c7f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:43.037801 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-d9e567b3-f391-4f43-8aff-293b65f0298b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:43.266014 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:44.060354 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:45.791483 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:52.174376 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40246) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:17:52.444091 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Deleting port 07f04f4e-e436-4366-bd86-313984214891 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:17:52.444433 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:52.563321 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:52.563640 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:52.797092 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Calling delete_port for 07f04f4e-e436-4366-bd86-313984214891 owned by network:floatingip {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:17:52.996270 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:53.000202 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:17:53.042832 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event deleted for resources: {'Port': ['ID=07f04f4e-e436-4366-bd86-313984214891,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:17:53.083044 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:53.083418 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:53.083786 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:53.084149 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:53.084506 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:53.084864 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:53.085225 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:53.085578 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:53.085933 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:53.086283 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:53.086632 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:53.087002 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:53.093767 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:17:53.146774 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for floatingip, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:53.147140 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.db.l3_db [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Floating IP c51de7d9-6100-4e87-af5a-d6af25067254 disassociated (deleted). External IP: 172.27.2.5, port: 76ab4fe7-d435-44e6-8eac-07c05d50efc4.
Jun 01 10:17:53.497869 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Router 426524f6-17bf-45cb-b42b-2fec9e039ff0 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:17:53.683358 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:17:53.692916 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1b2c826-2758-49b1-aa3b-aff0be97b145 None None] Sync routers for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:17:53.701975 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1b2c826-2758-49b1-aa3b-aff0be97b145 None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:17:53.702887 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-e1b2c826-2758-49b1-aa3b-aff0be97b145 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe71b23370>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:17:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:17:53.757155 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:53.814288 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-269eb59c-4106-48b1-b0a9-3eed19341672 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "DELETE /v2.0/floatingips/c51de7d9-6100-4e87-af5a-d6af25067254 HTTP/1.1" status: 204  len: 168 time: 1.6362157
Jun 01 10:17:53.814288 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '21a80279-3681-4303-b5c5-114fcc3aae4f', 'tag': '76ab4fe7-d435-44e6-8eac-07c05d50efc4'}] {{(pid=92565) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:17:53.814864 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b0082367f64f70f2a4bf3ab6833bfd28ef2485a56af6fcc4e615637d1a00723" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f1c03109-460c-4d65-91da-b16d97ad490d" -d '{"events": [{"name": "network-changed", "server_uuid": "21a80279-3681-4303-b5c5-114fcc3aae4f", "tag": "76ab4fe7-d435-44e6-8eac-07c05d50efc4"}]}' {{(pid=92565) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:17:53.890461 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-e1b2c826-2758-49b1-aa3b-aff0be97b145 None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:17:53.922818 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:17:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b25b924f-82b0-4763-a29d-0dc93dd7f154 x-openstack-request-id: req-b25b924f-82b0-4763-a29d-0dc93dd7f154 {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:17:53.923247 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "21a80279-3681-4303-b5c5-114fcc3aae4f", "tag": "76ab4fe7-d435-44e6-8eac-07c05d50efc4", "status": "completed", "code": 200}]} {{(pid=92565) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:17:53.923557 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-b25b924f-82b0-4763-a29d-0dc93dd7f154 {{(pid=92565) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:17:53.924008 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '21a80279-3681-4303-b5c5-114fcc3aae4f', 'tag': '76ab4fe7-d435-44e6-8eac-07c05d50efc4', 'status': 'completed', 'code': 200}
Jun 01 10:17:54.125156 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1c03109-460c-4d65-91da-b16d97ad490d req-0bb0d941-74ce-44a1-872b-be47b574c7b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:17:54.126597 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f1c03109-460c-4d65-91da-b16d97ad490d req-0bb0d941-74ce-44a1-872b-be47b574c7b3 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 1098 time: 0.1691687
Jun 01 10:17:54.253088 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-e1b2c826-2758-49b1-aa3b-aff0be97b145 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe71b23370>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '8dda3024-052e-4587-8448-6acdc53d117b', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'floating_ip_address': '172.27.2.28', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'port_id': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'mac_address': 'fa:16:3e:21:3e:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:14:01Z', 'updated_at': '2021-06-01T10:14:04Z', 'revision_number': 1, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:17:54.258119 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1b2c826-2758-49b1-aa3b-aff0be97b145 None None] Checking router: 426524f6-17bf-45cb-b42b-2fec9e039ff0 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:17:54.267166 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1b2c826-2758-49b1-aa3b-aff0be97b145 None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:17:54.267785 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-e1b2c826-2758-49b1-aa3b-aff0be97b145 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe71b23370>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:17:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:17:54.274987 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1c03109-460c-4d65-91da-b16d97ad490d req-e765bf20-8d36-4c1e-abc1-a484b9f1b50a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:17:54.277341 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f1c03109-460c-4d65-91da-b16d97ad490d req-e765bf20-8d36-4c1e-abc1-a484b9f1b50a service neutron] 10.222.0.30 "GET /v2.0/networks?id=83aff072-8820-4a36-b8f3-036a7011aace HTTP/1.1" status: 200  len: 910 time: 0.1407974
Jun 01 10:17:54.388249 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f1c03109-460c-4d65-91da-b16d97ad490d req-20e662c4-7b90-4542-8be5-ada729a64777 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=76ab4fe7-d435-44e6-8eac-07c05d50efc4 HTTP/1.1" status: 200  len: 217 time: 0.0992315
Jun 01 10:17:54.446064 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-e1b2c826-2758-49b1-aa3b-aff0be97b145 None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:17:54.470423 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1c03109-460c-4d65-91da-b16d97ad490d req-f534f05f-7264-4f78-9531-185d84c32914 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:17:54.471897 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f1c03109-460c-4d65-91da-b16d97ad490d req-f534f05f-7264-4f78-9531-185d84c32914 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=38dbf18a-9bde-4c4a-b149-d02ad12671d3 HTTP/1.1" status: 200  len: 848 time: 0.0761499
Jun 01 10:17:54.520702 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c61db508-5b74-4697-b854-d6c7a9363125 req-b695ab60-0323-4d6a-82e4-7a72c3d19b27 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:17:54.522177 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c61db508-5b74-4697-b854-d6c7a9363125 req-b695ab60-0323-4d6a-82e4-7a72c3d19b27 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 945 time: 0.1814318
Jun 01 10:17:54.584181 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c61db508-5b74-4697-b854-d6c7a9363125 req-ed42c222-eb83-4838-bfb8-452abb9a0b22 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0546894
Jun 01 10:17:54.593780 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1c03109-460c-4d65-91da-b16d97ad490d req-f7994a8b-b537-4c0c-ae8e-3d4295ae6337 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:17:54.595283 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f1c03109-460c-4d65-91da-b16d97ad490d req-f7994a8b-b537-4c0c-ae8e-3d4295ae6337 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=83aff072-8820-4a36-b8f3-036a7011aace&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1166651
Jun 01 10:17:54.730958 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f1c03109-460c-4d65-91da-b16d97ad490d req-55db5e3c-5ef0-4012-a303-f6cecad9b019 service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1279767
Jun 01 10:17:54.843383 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-e1b2c826-2758-49b1-aa3b-aff0be97b145 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe71b23370>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '8dda3024-052e-4587-8448-6acdc53d117b', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'floating_ip_address': '172.27.2.28', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'port_id': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'mac_address': 'fa:16:3e:21:3e:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:14:01Z', 'updated_at': '2021-06-01T10:14:04Z', 'revision_number': 1, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:17:54.847294 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1b2c826-2758-49b1-aa3b-aff0be97b145 None None] The sync data for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi is: [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_floatingips': [{'id': '8dda3024-052e-4587-8448-6acdc53d117b', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'floating_ip_address': '172.27.2.28', 'floating_network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'router_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'port_id': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea', 'fixed_ip_address': '172.20.0.9', 'status': 'ACTIVE', 'standard_attr_id': 547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'mac_address': 'fa:16:3e:21:3e:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T10:14:01Z', 'updated_at': '2021-06-01T10:14:04Z', 'revision_number': 1, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:17:54.867683 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f1c03109-460c-4d65-91da-b16d97ad490d req-b0d938df-51d4-40d2-93c8-6376b235f295 service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1300919
Jun 01 10:17:55.062794 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45a74382-5955-4889-b95c-7f6f82bb1131 None None] New status for floating IP c51de7d9-6100-4e87-af5a-d6af25067254: DOWN {{(pid=92568) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:17:55.778687 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d320a58-0a4b-49c0-9b23-29dc0983b734 req-79dc6aa0-3da6-4581-b870-464549d2d27b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:17:55.780183 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7d320a58-0a4b-49c0-9b23-29dc0983b734 req-79dc6aa0-3da6-4581-b870-464549d2d27b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 945 time: 0.0850456
Jun 01 10:17:55.823781 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7d320a58-0a4b-49c0-9b23-29dc0983b734 req-24bea325-4945-429f-b308-7cf7b0beb00c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0373602
Jun 01 10:17:56.095911 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ceb686d-faa3-4428-aed7-11a4fbf75940 req-597cdae9-bcfc-49a1-bb3a-05c568068ac3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:17:56.097333 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ceb686d-faa3-4428-aed7-11a4fbf75940 req-597cdae9-bcfc-49a1-bb3a-05c568068ac3 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.30 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 945 time: 0.0788596
Jun 01 10:17:56.233058 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-4ceb686d-faa3-4428-aed7-11a4fbf75940 req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Deleting port 76ab4fe7-d435-44e6-8eac-07c05d50efc4 {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:17:56.233397 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-4ceb686d-faa3-4428-aed7-11a4fbf75940 req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:56.365089 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-4ceb686d-faa3-4428-aed7-11a4fbf75940 req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] For port 76ab4fe7-d435-44e6-8eac-07c05d50efc4, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=76ab4fe7-d435-44e6-8eac-07c05d50efc4,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:17:56.365389 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-4ceb686d-faa3-4428-aed7-11a4fbf75940 req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:56.487446 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-4ceb686d-faa3-4428-aed7-11a4fbf75940 req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Calling delete_port for 76ab4fe7-d435-44e6-8eac-07c05d50efc4 owned by compute:nova {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:17:56.586005 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:56.761927 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-4ceb686d-faa3-4428-aed7-11a4fbf75940 req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:56.768513 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-f1960752-eebb-49be-a422-303a95820699 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:17:56.812818 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event deleted for resources: {'Port': ['ID=76ab4fe7-d435-44e6-8eac-07c05d50efc4,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:17:56.888728 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:56.888728 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:56.888728 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:56.888728 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:56.888728 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:56.888728 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:56.888728 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:56.888728 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:56.888728 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:56.888728 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:56.888728 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:56.888728 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:17:56.954618 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:17:57.037493 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-4ceb686d-faa3-4428-aed7-11a4fbf75940 req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] No DVR routers for this DVR port 76ab4fe7-d435-44e6-8eac-07c05d50efc4 on host hv-cinder-78726 {{(pid=92566) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:17:57.040640 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b7e84a45-1fe9-4b68-8dc1-6dff2aae9490 req-6e873c01-e5f9-4e38-985b-00f3cfb178e8 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 210 time: 0.0849676
Jun 01 10:17:57.041595 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-4ceb686d-faa3-4428-aed7-11a4fbf75940 req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:17:57.044304 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '21a80279-3681-4303-b5c5-114fcc3aae4f', 'name': 'network-vif-deleted', 'tag': '76ab4fe7-d435-44e6-8eac-07c05d50efc4'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:17:57.046463 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-289f23e1-a63e-4c94-a4ae-c1823045770c" -d '{"events": [{"server_uuid": "21a80279-3681-4303-b5c5-114fcc3aae4f", "name": "network-vif-deleted", "tag": "76ab4fe7-d435-44e6-8eac-07c05d50efc4"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:17:57.055861 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-4ceb686d-faa3-4428-aed7-11a4fbf75940 req-7d89aaaf-b1d6-4970-bc07-3c1af3bc315b tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.30 "DELETE /v2.0/ports/76ab4fe7-d435-44e6-8eac-07c05d50efc4 HTTP/1.1" status: 204  len: 173 time: 0.9502442
Jun 01 10:17:57.089677 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:17:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f2e928f7-8f2d-4dc9-9440-06ad2bbe6f59 x-openstack-request-id: req-f2e928f7-8f2d-4dc9-9440-06ad2bbe6f59 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:17:57.090011 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "21a80279-3681-4303-b5c5-114fcc3aae4f", "name": "network-vif-deleted", "tag": "76ab4fe7-d435-44e6-8eac-07c05d50efc4", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:17:57.090300 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-f2e928f7-8f2d-4dc9-9440-06ad2bbe6f59 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:17:57.090729 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '21a80279-3681-4303-b5c5-114fcc3aae4f', 'name': 'network-vif-deleted', 'tag': '76ab4fe7-d435-44e6-8eac-07c05d50efc4', 'status': 'completed', 'code': 200}
Jun 01 10:17:58.206336 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-79f889f0-e686-48a4-8fbb-7e27ac4962ea req-05d675d6-028d-46a3-bed6-514e4280d8ec tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Synchronizing usage tracker for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:17:58.294067 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-79f889f0-e686-48a4-8fbb-7e27ac4962ea req-05d675d6-028d-46a3-bed6-514e4280d8ec tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Unset dirty status for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:17:58.298605 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-79f889f0-e686-48a4-8fbb-7e27ac4962ea req-05d675d6-028d-46a3-bed6-514e4280d8ec tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=21a80279-3681-4303-b5c5-114fcc3aae4f HTTP/1.1" status: 200  len: 210 time: 0.1342633
Jun 01 10:17:58.726743 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 76ab4fe7-d435-44e6-8eac-07c05d50efc4 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:17:58.761654 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: 76ab4fe7-d435-44e6-8eac-07c05d50efc4 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:17:58.762011 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 76ab4fe7-d435-44e6-8eac-07c05d50efc4 not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:17:59.466946 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:18:01.983707 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 40282) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:18:02.248439 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-07f89f12-0d7e-4a67-b93f-cfc9193d26ef tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Deleting port acccd76e-4190-45f1-9b7d-5a4b80879793 {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:18:02.248808 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-07f89f12-0d7e-4a67-b93f-cfc9193d26ef tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:02.367034 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-07f89f12-0d7e-4a67-b93f-cfc9193d26ef tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:02.367403 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-07f89f12-0d7e-4a67-b93f-cfc9193d26ef tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:02.490481 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-07f89f12-0d7e-4a67-b93f-cfc9193d26ef tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Calling delete_port for acccd76e-4190-45f1-9b7d-5a4b80879793 owned by network:floatingip {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:18:02.682796 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-07f89f12-0d7e-4a67-b93f-cfc9193d26ef tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:02.687430 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-49e51831-895b-436f-a065-f7955e248cc1 tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:02.733909 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07f89f12-0d7e-4a67-b93f-cfc9193d26ef tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event deleted for resources: {'Port': ['ID=acccd76e-4190-45f1-9b7d-5a4b80879793,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:02.737036 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-07f89f12-0d7e-4a67-b93f-cfc9193d26ef tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:02.827565 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-07f89f12-0d7e-4a67-b93f-cfc9193d26ef tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for floatingip, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:02.827920 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.l3_db [None req-07f89f12-0d7e-4a67-b93f-cfc9193d26ef tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Floating IP 8dda3024-052e-4587-8448-6acdc53d117b disassociated (deleted). External IP: 172.27.2.28, port: 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea.
Jun 01 10:18:03.176154 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07f89f12-0d7e-4a67-b93f-cfc9193d26ef tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Router 426524f6-17bf-45cb-b42b-2fec9e039ff0 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92566) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:18:03.453473 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07f89f12-0d7e-4a67-b93f-cfc9193d26ef tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:18:03.462940 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c97f5924-300f-40c5-8f96-e15f5eb70464 None None] Sync routers for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:18:03.472760 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c97f5924-300f-40c5-8f96-e15f5eb70464 None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:18:03.473373 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-c97f5924-300f-40c5-8f96-e15f5eb70464 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe727bb520>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:17:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:03.545783 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-07f89f12-0d7e-4a67-b93f-cfc9193d26ef tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:03.600804 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-07f89f12-0d7e-4a67-b93f-cfc9193d26ef tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "DELETE /v2.0/floatingips/8dda3024-052e-4587-8448-6acdc53d117b HTTP/1.1" status: 204  len: 168 time: 1.6160209
Jun 01 10:18:03.601556 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'tag': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:18:03.603985 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c18e450f-129d-49cf-930e-2951baea613a" -d '{"events": [{"name": "network-changed", "server_uuid": "00b98054-6f11-49b6-b07f-3178e4e5472d", "tag": "7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:18:03.647941 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:18:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-774be30d-d861-43a7-8808-a8532cfaae57 x-openstack-request-id: req-774be30d-d861-43a7-8808-a8532cfaae57 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:18:03.648258 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "00b98054-6f11-49b6-b07f-3178e4e5472d", "tag": "7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:18:03.648536 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-774be30d-d861-43a7-8808-a8532cfaae57 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:18:03.649120 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'tag': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea', 'status': 'completed', 'code': 200}
Jun 01 10:18:03.654688 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-c97f5924-300f-40c5-8f96-e15f5eb70464 None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:18:03.767858 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c18e450f-129d-49cf-930e-2951baea613a req-a772d682-ed48-4618-8f60-7f302c0e7202 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:03.767858 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c18e450f-129d-49cf-930e-2951baea613a req-a772d682-ed48-4618-8f60-7f302c0e7202 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=cfa9132b1ba044548228b96f6c2755eb&device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 1098 time: 0.0878193
Jun 01 10:18:03.907114 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c18e450f-129d-49cf-930e-2951baea613a req-e937bf89-270d-4bb6-aad3-ac50653326bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:03.908701 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c18e450f-129d-49cf-930e-2951baea613a req-e937bf89-270d-4bb6-aad3-ac50653326bd service neutron] 10.222.0.30 "GET /v2.0/networks?id=83aff072-8820-4a36-b8f3-036a7011aace HTTP/1.1" status: 200  len: 910 time: 0.1314349
Jun 01 10:18:03.991393 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c18e450f-129d-49cf-930e-2951baea613a req-d0749c6c-e2ff-4591-892f-64e3b1e07355 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea HTTP/1.1" status: 200  len: 217 time: 0.0724273
Jun 01 10:18:03.997804 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-c97f5924-300f-40c5-8f96-e15f5eb70464 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe727bb520>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:04.001988 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c97f5924-300f-40c5-8f96-e15f5eb70464 None None] Checking router: 426524f6-17bf-45cb-b42b-2fec9e039ff0 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:18:04.010669 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c97f5924-300f-40c5-8f96-e15f5eb70464 None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:18:04.011318 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-c97f5924-300f-40c5-8f96-e15f5eb70464 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe727bb520>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:17:43Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:04.063240 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c18e450f-129d-49cf-930e-2951baea613a req-ea24765d-f977-4cba-8fa5-baba6abce852 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:04.064717 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c18e450f-129d-49cf-930e-2951baea613a req-ea24765d-f977-4cba-8fa5-baba6abce852 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=38dbf18a-9bde-4c4a-b149-d02ad12671d3 HTTP/1.1" status: 200  len: 848 time: 0.0636144
Jun 01 10:18:04.189825 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-c97f5924-300f-40c5-8f96-e15f5eb70464 None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:18:04.200523 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c707ea9-073e-4914-82cc-43eb70dd0bdb req-9da66468-b823-4cc0-9da0-b5149c96f56f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:04.201219 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-8c707ea9-073e-4914-82cc-43eb70dd0bdb req-9da66468-b823-4cc0-9da0-b5149c96f56f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Synchronizing usage tracker for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:18:04.205859 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c18e450f-129d-49cf-930e-2951baea613a req-444f62a1-9b15-4214-9286-0fc9797f7077 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:04.207311 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c18e450f-129d-49cf-930e-2951baea613a req-444f62a1-9b15-4214-9286-0fc9797f7077 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=83aff072-8820-4a36-b8f3-036a7011aace&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1075890
Jun 01 10:18:04.286763 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-8c707ea9-073e-4914-82cc-43eb70dd0bdb req-9da66468-b823-4cc0-9da0-b5149c96f56f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Unset dirty status for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:18:04.287861 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8c707ea9-073e-4914-82cc-43eb70dd0bdb req-9da66468-b823-4cc0-9da0-b5149c96f56f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 945 time: 0.2222881
Jun 01 10:18:04.371005 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8c707ea9-073e-4914-82cc-43eb70dd0bdb req-9f116900-a486-4e7e-899c-28296c3b78d5 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0753903
Jun 01 10:18:04.387743 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c18e450f-129d-49cf-930e-2951baea613a req-e35e4639-853f-4a26-8ba4-051a5904c8f5 service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1719053
Jun 01 10:18:04.516875 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-c97f5924-300f-40c5-8f96-e15f5eb70464 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe727bb520>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:04.520684 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c18e450f-129d-49cf-930e-2951baea613a req-71b46611-2d80-467c-8403-6fd0785495dd service neutron] 10.222.0.30 "GET /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1252916
Jun 01 10:18:04.520963 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c97f5924-300f-40c5-8f96-e15f5eb70464 None None] The sync data for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi is: [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:10:13Z', 'revision_number': 4, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': 'f5cd5bf7-9718-4375-b561-e61f796ff6b8', 'name': '', 'network_id': '83aff072-8820-4a36-b8f3-036a7011aace', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'mac_address': 'fa:16:3e:0f:49:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_interface', 'standard_attr_id': 398, 'fixed_ips': [{'subnet_id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:12Z', 'updated_at': '2021-06-01T10:10:21Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'subnets': [{'id': '38dbf18a-9bde-4c4a-b149-d02ad12671d3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:18:04.730616 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4520e600-94a1-48a7-a8c7-2d4cae665159 None None] New status for floating IP 8dda3024-052e-4587-8448-6acdc53d117b: DOWN {{(pid=92568) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:18:05.554190 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e70032f3-9d50-45cd-999a-a355c8fb8fcd req-00cdee2c-4d74-49c4-8990-a07ed58f2332 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:05.555681 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e70032f3-9d50-45cd-999a-a355c8fb8fcd req-00cdee2c-4d74-49c4-8990-a07ed58f2332 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 945 time: 0.0797477
Jun 01 10:18:05.599304 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e70032f3-9d50-45cd-999a-a355c8fb8fcd req-981d3be7-d881-4c81-b074-b5169691ec37 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/security-groups?id=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0373895
Jun 01 10:18:05.736182 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2fb0882-75bc-4a9e-9385-3a42ab1cc38a req-53fd5e30-7c7d-4873-8800-22da7d1abea0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:05.737638 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f2fb0882-75bc-4a9e-9385-3a42ab1cc38a req-53fd5e30-7c7d-4873-8800-22da7d1abea0 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.30 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 945 time: 0.0825324
Jun 01 10:18:05.874253 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-f2fb0882-75bc-4a9e-9385-3a42ab1cc38a req-670d81a3-61c7-4999-8bfd-9f1d4ac4159f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Deleting port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:18:05.874588 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-f2fb0882-75bc-4a9e-9385-3a42ab1cc38a req-670d81a3-61c7-4999-8bfd-9f1d4ac4159f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:06.007433 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-f2fb0882-75bc-4a9e-9385-3a42ab1cc38a req-670d81a3-61c7-4999-8bfd-9f1d4ac4159f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] For port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:18:06.007686 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-f2fb0882-75bc-4a9e-9385-3a42ab1cc38a req-670d81a3-61c7-4999-8bfd-9f1d4ac4159f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:06.220163 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-f2fb0882-75bc-4a9e-9385-3a42ab1cc38a req-670d81a3-61c7-4999-8bfd-9f1d4ac4159f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Calling delete_port for 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea owned by compute:nova {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:18:06.384721 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-f2fb0882-75bc-4a9e-9385-3a42ab1cc38a req-670d81a3-61c7-4999-8bfd-9f1d4ac4159f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:06.390796 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-8201eb81-f81a-41e8-919a-f9aea59227d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:06.438088 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-670d81a3-61c7-4999-8bfd-9f1d4ac4159f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event deleted for resources: {'Port': ['ID=7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:06.442243 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-670d81a3-61c7-4999-8bfd-9f1d4ac4159f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:06.514091 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-f2fb0882-75bc-4a9e-9385-3a42ab1cc38a req-670d81a3-61c7-4999-8bfd-9f1d4ac4159f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] No DVR routers for this DVR port 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea on host hv-cinder-78726 {{(pid=92566) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:18:06.516464 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-f2fb0882-75bc-4a9e-9385-3a42ab1cc38a req-670d81a3-61c7-4999-8bfd-9f1d4ac4159f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:06.518880 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'name': 'network-vif-deleted', 'tag': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:18:06.521117 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3b78ba0c-f71c-4bb6-a017-0a54003cddab" -d '{"events": [{"server_uuid": "00b98054-6f11-49b6-b07f-3178e4e5472d", "name": "network-vif-deleted", "tag": "7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:18:06.566693 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:18:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1ada1b44-6d4f-49a7-be43-160a00dd8c5d x-openstack-request-id: req-1ada1b44-6d4f-49a7-be43-160a00dd8c5d {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:18:06.571601 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "00b98054-6f11-49b6-b07f-3178e4e5472d", "name": "network-vif-deleted", "tag": "7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:18:06.571601 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-1ada1b44-6d4f-49a7-be43-160a00dd8c5d {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:18:06.571601 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '00b98054-6f11-49b6-b07f-3178e4e5472d', 'name': 'network-vif-deleted', 'tag': '7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea', 'status': 'completed', 'code': 200}
Jun 01 10:18:06.592282 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f2fb0882-75bc-4a9e-9385-3a42ab1cc38a req-670d81a3-61c7-4999-8bfd-9f1d4ac4159f tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.30 "DELETE /v2.0/ports/7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea HTTP/1.1" status: 204  len: 173 time: 0.8453727
Jun 01 10:18:06.758196 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-d8917871-88c9-4e17-a7a5-6320ece92204 req-0a0f0d78-7cdc-4f6a-83ac-3e560e7de9e4 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Synchronizing usage tracker for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:18:06.877429 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-d8917871-88c9-4e17-a7a5-6320ece92204 req-0a0f0d78-7cdc-4f6a-83ac-3e560e7de9e4 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Unset dirty status for tenant:cfa9132b1ba044548228b96f6c2755eb on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:18:06.878614 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d8917871-88c9-4e17-a7a5-6320ece92204 req-0a0f0d78-7cdc-4f6a-83ac-3e560e7de9e4 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 210 time: 0.1682138
Jun 01 10:18:08.041153 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2ae544e7-2a98-49ac-84c7-6df0d59e27c8 req-da93d54f-59fc-479d-8e63-3f3ae386e85c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "GET /v2.0/ports?device_id=00b98054-6f11-49b6-b07f-3178e4e5472d HTTP/1.1" status: 200  len: 210 time: 0.0431354
Jun 01 10:18:08.805508 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:18:08.840564 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:18:08.840915 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device 7aa7786e-7fb9-4f1f-9fd1-8b9f41d7e4ea not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:18:09.133884 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40302) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:18:09.348867 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-aaeee3d1-9ebc-49e8-8dc9-e4f20ca64650 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Deleting port dd7d47ff-2d30-4183-8be4-fa4d48638753 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:18:09.349121 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-aaeee3d1-9ebc-49e8-8dc9-e4f20ca64650 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:09.467300 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-aaeee3d1-9ebc-49e8-8dc9-e4f20ca64650 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:09.467636 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-aaeee3d1-9ebc-49e8-8dc9-e4f20ca64650 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:09.703617 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-aaeee3d1-9ebc-49e8-8dc9-e4f20ca64650 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Calling delete_port for dd7d47ff-2d30-4183-8be4-fa4d48638753 owned by network:floatingip {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:18:09.888703 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-aaeee3d1-9ebc-49e8-8dc9-e4f20ca64650 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:09.892398 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-1be30080-ffb1-4adf-99a5-e1727d10e09c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:09.934844 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaeee3d1-9ebc-49e8-8dc9-e4f20ca64650 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event deleted for resources: {'Port': ['ID=dd7d47ff-2d30-4183-8be4-fa4d48638753,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:09.938448 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-aaeee3d1-9ebc-49e8-8dc9-e4f20ca64650 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:10.028667 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-aaeee3d1-9ebc-49e8-8dc9-e4f20ca64650 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for floatingip, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:10.104270 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-aaeee3d1-9ebc-49e8-8dc9-e4f20ca64650 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:10.105419 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-aaeee3d1-9ebc-49e8-8dc9-e4f20ca64650 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "DELETE /v2.0/floatingips/30889bd5-5712-4195-ae97-644587fcd5a3 HTTP/1.1" status: 204  len: 168 time: 0.9705780
Jun 01 10:18:10.499323 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-dce7da12-9c1e-4be3-9097-b7ddd1523580 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:11.619676 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40318) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:18:11.688229 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bb712a44-b239-4a7a-b3e0-439c094bb928 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:11.717843 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bb712a44-b239-4a7a-b3e0-439c094bb928 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:11.877226 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bb712a44-b239-4a7a-b3e0-439c094bb928 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:11.881112 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-1de5a316-0882-4de1-b927-db6106aa26cb tempest-AttachVolumeTestJSON-1975482483 tempest-AttachVolumeTestJSON-1975482483-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:11.900310 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb712a44-b239-4a7a-b3e0-439c094bb928 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=53e3d69f-76f1-4e9a-808e-b6a7c88db3f4,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:11.902884 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-bb712a44-b239-4a7a-b3e0-439c094bb928 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:11.973371 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-bb712a44-b239-4a7a-b3e0-439c094bb928 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:11.974494 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-bb712a44-b239-4a7a-b3e0-439c094bb928 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] 10.222.0.68 "DELETE /v2.0/security-groups/53e3d69f-76f1-4e9a-808e-b6a7c88db3f4 HTTP/1.1" status: 204  len: 168 time: 0.3538411
Jun 01 10:18:12.084512 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40326) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:18:12.728711 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d5f3d75f-a1d8-4ce8-93eb-d9784d226f6b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-401846'] for router_interface, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:13.002747 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-504629a4-1024-4e32-90d7-877e07bc51bd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:13.136634 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-d5f3d75f-a1d8-4ce8-93eb-d9784d226f6b admin admin] Deleting port f5cd5bf7-9718-4375-b561-e61f796ff6b8 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:18:13.136973 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d5f3d75f-a1d8-4ce8-93eb-d9784d226f6b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:13.253047 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:13.363976 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-d5f3d75f-a1d8-4ce8-93eb-d9784d226f6b admin admin] For port f5cd5bf7-9718-4375-b561-e61f796ff6b8, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=f5cd5bf7-9718-4375-b561-e61f796ff6b8,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:18:13.364333 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d5f3d75f-a1d8-4ce8-93eb-d9784d226f6b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:13.484927 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-d5f3d75f-a1d8-4ce8-93eb-d9784d226f6b admin admin] Calling delete_port for f5cd5bf7-9718-4375-b561-e61f796ff6b8 owned by network:router_interface {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:18:13.768888 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d5f3d75f-a1d8-4ce8-93eb-d9784d226f6b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:13.772837 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b9135f54-3581-4bf9-a4f7-5b29fd2f9d23 tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:13.816792 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5f3d75f-a1d8-4ce8-93eb-d9784d226f6b admin admin] Pushing event deleted for resources: {'Port': ['ID=f5cd5bf7-9718-4375-b561-e61f796ff6b8,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:13.819922 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-d5f3d75f-a1d8-4ce8-93eb-d9784d226f6b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:14.048704 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:14.094539 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-d5f3d75f-a1d8-4ce8-93eb-d9784d226f6b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7875317', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-405030'] for router_interface, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:14.464153 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d5f3d75f-a1d8-4ce8-93eb-d9784d226f6b admin admin] Router 426524f6-17bf-45cb-b42b-2fec9e039ff0 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:18:14.639605 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d5f3d75f-a1d8-4ce8-93eb-d9784d226f6b admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:18:14.648567 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a82d69a5-eed6-4ef7-ab65-eaf48b826a37 None None] Sync routers for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:18:14.654652 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-d5f3d75f-a1d8-4ce8-93eb-d9784d226f6b admin admin] 10.222.0.68 "PUT /v2.0/routers/426524f6-17bf-45cb-b42b-2fec9e039ff0/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5684674
Jun 01 10:18:14.657074 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40334) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:18:14.658344 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a82d69a5-eed6-4ef7-ab65-eaf48b826a37 None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:18:14.659398 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-a82d69a5-eed6-4ef7-ab65-eaf48b826a37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe71aa7ee0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:18:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:14.880353 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-a82d69a5-eed6-4ef7-ab65-eaf48b826a37 None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:18:14.948290 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4a85e566-d4a3-45a6-aab0-c3ca6d18a38e admin admin] Notify callbacks [] for router, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:15.125154 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4a85e566-d4a3-45a6-aab0-c3ca6d18a38e admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:15.172629 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-a82d69a5-eed6-4ef7-ab65-eaf48b826a37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe71aa7ee0>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200'}], 'enable_snat': True}, 'gw_port_id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:18:13Z', 'revision_number': 5, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port': {'id': 'b61f43ed-7118-4cdc-b650-27da1d3644ed', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:01:62:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:09Z', 'updated_at': '2021-06-01T10:10:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:15.176405 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a82d69a5-eed6-4ef7-ab65-eaf48b826a37 None None] Checking router: 426524f6-17bf-45cb-b42b-2fec9e039ff0 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:18:15.184622 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a82d69a5-eed6-4ef7-ab65-eaf48b826a37 None None] Routers {'426524f6-17bf-45cb-b42b-2fec9e039ff0'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:18:15.185872 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-a82d69a5-eed6-4ef7-ab65-eaf48b826a37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe71aa7ee0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:18:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['426524f6-17bf-45cb-b42b-2fec9e039ff0'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:15.248685 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-4a85e566-d4a3-45a6-aab0-c3ca6d18a38e admin admin] Deleting port b61f43ed-7118-4cdc-b650-27da1d3644ed {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:18:15.249024 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4a85e566-d4a3-45a6-aab0-c3ca6d18a38e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:15.335644 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-a82d69a5-eed6-4ef7-ab65-eaf48b826a37 None None] Set router 426524f6-17bf-45cb-b42b-2fec9e039ff0 gateway port host: None {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:18:15.370237 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-4a85e566-d4a3-45a6-aab0-c3ca6d18a38e admin admin] For port b61f43ed-7118-4cdc-b650-27da1d3644ed, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=b61f43ed-7118-4cdc-b650-27da1d3644ed,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:18:15.370590 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4a85e566-d4a3-45a6-aab0-c3ca6d18a38e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:15.442041 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-a82d69a5-eed6-4ef7-ab65-eaf48b826a37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe71aa7ee0>, [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:18:15Z', 'revision_number': 6, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port_host': None}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:15.445977 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a82d69a5-eed6-4ef7-ab65-eaf48b826a37 None None] The sync data for ids ['426524f6-17bf-45cb-b42b-2fec9e039ff0'] in dv-cinder-787262-4-iscsi is: [{'id': '426524f6-17bf-45cb-b42b-2fec9e039ff0', 'name': 'tempest-TestVolumeBootPattern-4490896-router', 'tenant_id': 'cfa9132b1ba044548228b96f6c2755eb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:08Z', 'updated_at': '2021-06-01T10:18:15Z', 'revision_number': 6, 'project_id': 'cfa9132b1ba044548228b96f6c2755eb', 'gw_port_host': None}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:18:15.492658 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-4a85e566-d4a3-45a6-aab0-c3ca6d18a38e admin admin] Calling delete_port for b61f43ed-7118-4cdc-b650-27da1d3644ed owned by network:router_gateway {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:18:15.688607 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4a85e566-d4a3-45a6-aab0-c3ca6d18a38e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:15.692349 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8965fd57-ec5c-4ab2-abe4-4e370026a312 tempest-VolumesNegativeTest-855483673 tempest-VolumesNegativeTest-855483673-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:15.736556 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a85e566-d4a3-45a6-aab0-c3ca6d18a38e admin admin] Pushing event deleted for resources: {'Port': ['ID=b61f43ed-7118-4cdc-b650-27da1d3644ed,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:15.769465 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-4a85e566-d4a3-45a6-aab0-c3ca6d18a38e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:15.815425 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:15.835038 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4a85e566-d4a3-45a6-aab0-c3ca6d18a38e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-403627'] for router_gateway, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:16.015557 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4a85e566-d4a3-45a6-aab0-c3ca6d18a38e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-405542', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-15816'] for router, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:16.017937 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4a85e566-d4a3-45a6-aab0-c3ca6d18a38e admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:16.105195 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4a85e566-d4a3-45a6-aab0-c3ca6d18a38e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-406042'] for router, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:16.105696 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4a85e566-d4a3-45a6-aab0-c3ca6d18a38e admin admin] Fanout notify agent at l3_agent the message router_deleted on router 426524f6-17bf-45cb-b42b-2fec9e039ff0 {{(pid=92565) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 10:18:16.118047 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-4a85e566-d4a3-45a6-aab0-c3ca6d18a38e admin admin] Notify callbacks [] for router, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:16.119189 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-4a85e566-d4a3-45a6-aab0-c3ca6d18a38e admin admin] 10.222.0.68 "DELETE /v2.0/routers/426524f6-17bf-45cb-b42b-2fec9e039ff0 HTTP/1.1" status: 204  len: 168 time: 1.4612048
Jun 01 10:18:16.121631 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40338) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:18:16.179970 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_v2 [None req-7711c0b7-ee61-4c98-b228-9134060057a2 admin admin] Deleting subnet 38dbf18a-9bde-4c4a-b149-d02ad12671d3 {{(pid=92565) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 10:18:16.182714 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7711c0b7-ee61-4c98-b228-9134060057a2 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:16.222157 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device f5cd5bf7-9718-4375-b561-e61f796ff6b8 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:18:16.240450 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7711c0b7-ee61-4c98-b228-9134060057a2 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2998467'] for subnet, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:16.258768 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: f5cd5bf7-9718-4375-b561-e61f796ff6b8 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:18:16.259139 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device f5cd5bf7-9718-4375-b561-e61f796ff6b8 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:18:16.324133 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7711c0b7-ee61-4c98-b228-9134060057a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7791835'] for subnet, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:16.746996 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7711c0b7-ee61-4c98-b228-9134060057a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7793006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2233195', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3139387'] for subnet, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:16.750871 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-91c68965-0f88-4f6f-9faf-84bd45789c5b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:16.786228 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7711c0b7-ee61-4c98-b228-9134060057a2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=38dbf18a-9bde-4c4a-b149-d02ad12671d3,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:16.788748 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7711c0b7-ee61-4c98-b228-9134060057a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:16.796774 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7711c0b7-ee61-4c98-b228-9134060057a2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:16.799127 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-7711c0b7-ee61-4c98-b228-9134060057a2 admin admin] 10.222.0.68 "DELETE /v2.0/subnets/38dbf18a-9bde-4c4a-b149-d02ad12671d3 HTTP/1.1" status: 204  len: 168 time: 0.6765468
Jun 01 10:18:16.799815 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d725b4ad-098e-4474-87c7-65e1facb9429 None None] Network 83aff072-8820-4a36-b8f3-036a7011aace requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:18:16.801560 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40342) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:18:16.906175 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7813807'] for network, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:16.976532 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Deleting port 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:18:16.976876 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:17.052945 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] DHCP port deletion for 83aff072-8820-4a36-b8f3-036a7011aace request from dv-cinder-787262-4-iscsi {{(pid=92567) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 10:18:17.084863 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] For port 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:18:17.085480 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:17.118184 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Deleting port 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b {{(pid=92567) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:18:17.118566 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:17.209460 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Calling delete_port for 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b owned by network:dhcp {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:18:17.219546 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] For port 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b,segment=NetworkSegment(fa0b3f88-fc98-4047-ba13-b4db68c2afa1),segment_id=fa0b3f88-fc98-4047-ba13-b4db68c2afa1)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:18:17.219947 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:17.329056 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:17.332924 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:17.342407 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Calling delete_port for 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b owned by network:dhcp {{(pid=92567) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:18:17.378049 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Pushing event deleted for resources: {'Port': ['ID=39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:17.381515 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:17.382426 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] No DVR routers for this DVR port 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b on host dv-cinder-787262-4-iscsi {{(pid=92565) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:18:17.390428 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820'] for port, after_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:17.394114 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-cd6b8272-f065-49cd-8dfb-89626af5fbe1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:17.435133 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Pushing event deleted for resources: {'Port': ['ID=39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b,revision_number=None']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:17.445133 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] No DVR routers for this DVR port 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b on host dv-cinder-787262-4-iscsi {{(pid=92567) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:18:17.447334 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:18:17.447684 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:18:17.448023 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:18:17.448358 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:18:17.448692 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:18:17.449021 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:18:17.449346 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:18:17.449674 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:18:17.450005 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:18:17.450356 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:18:17.450714 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:18:17.451581 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:18:17.455030 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-9549a9c0-991f-4449-b049-34e40dbe1e4a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:17.497901 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7795028', 'neutron.services.segments.db._delete_segments_for_network-8726958294492'] for network, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:17.510490 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7efe7137f790>,) {'filters': {'network_id': ['83aff072-8820-4a36-b8f3-036a7011aace']}} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:17.523142 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7efe7137f790>, 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1') {'for_net_delete': True} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:17.523438 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7efe7137f790>, 'fa0b3f88-fc98-4047-ba13-b4db68c2afa1') {} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:17.535059 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726958303133', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2998472'] for segment, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:17.551034 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:17.558990 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Releasing vlan 857 on physical network physnet1 to pool {{(pid=92565) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 10:18:17.560796 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2295757'] for segment, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]: Traceback (most recent call last):
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:     timer()
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:     cb(*args, **kw)
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:     return func(*args, **kwargs)
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:     self._notify()
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:     self.callback(batched_events)
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:     event.method(event)
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:     return f(self, *a, **k)
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._get(url).json()
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self.request(url, 'GET', **kwargs)
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 10:18:17.572785 dv-cinder-787262-4-iscsi neutron-server[92565]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 10:18:17.745886 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7795037', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-403638'] for network, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:17.749432 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-6b70b430-1c1e-41be-97ba-041c8f773a20 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:17.763076 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:17.773689 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Pushing event deleted for resources: {'Network': ['ID=83aff072-8820-4a36-b8f3-036a7011aace,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:17.776900 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:17.820789 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device b61f43ed-7118-4cdc-b650-27da1d3644ed no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:18:17.826585 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] 10.222.0.68 "DELETE /v2.0/networks/83aff072-8820-4a36-b8f3-036a7011aace HTTP/1.1" status: 204  len: 168 time: 1.0240402
Jun 01 10:18:17.829373 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40346) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:18:17.854928 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: b61f43ed-7118-4cdc-b650-27da1d3644ed {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:18:17.855284 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device b61f43ed-7118-4cdc-b650-27da1d3644ed not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:18:17.855701 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:18:17.928720 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:18:17.929063 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 39291bff-a8b1-4dcf-b5c1-5d1ba45cc71b not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:18:18.460518 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-72a02ca1-346f-4372-854e-b4b6ca4de7b5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-401846'] for router_interface, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:18.860258 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-72a02ca1-346f-4372-854e-b4b6ca4de7b5 admin admin] Deleting port f30fad44-c9e2-4619-8a3a-64a7a505f0a4 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:18:18.860593 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-72a02ca1-346f-4372-854e-b4b6ca4de7b5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:18.979026 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-72a02ca1-346f-4372-854e-b4b6ca4de7b5 admin admin] For port f30fad44-c9e2-4619-8a3a-64a7a505f0a4, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=f30fad44-c9e2-4619-8a3a-64a7a505f0a4,segment=NetworkSegment(7e83dd0c-3be4-4412-8849-fe1a2cad78c1),segment_id=7e83dd0c-3be4-4412-8849-fe1a2cad78c1)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:18:18.979378 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-72a02ca1-346f-4372-854e-b4b6ca4de7b5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:19.101544 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-72a02ca1-346f-4372-854e-b4b6ca4de7b5 admin admin] Calling delete_port for f30fad44-c9e2-4619-8a3a-64a7a505f0a4 owned by network:router_interface {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:18:19.380452 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-72a02ca1-346f-4372-854e-b4b6ca4de7b5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:19.384472 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-59a57e7f-fd36-470c-9aef-7919ab0e7d5a tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:19.438101 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72a02ca1-346f-4372-854e-b4b6ca4de7b5 admin admin] Pushing event deleted for resources: {'Port': ['ID=f30fad44-c9e2-4619-8a3a-64a7a505f0a4,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:19.441869 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-72a02ca1-346f-4372-854e-b4b6ca4de7b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:19.701437 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-72a02ca1-346f-4372-854e-b4b6ca4de7b5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7875317', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-405030'] for router_interface, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:20.168964 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-72a02ca1-346f-4372-854e-b4b6ca4de7b5 admin admin] Router 00920640-a6b6-40f1-9c3d-5d67417288d3 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:18:20.344651 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-72a02ca1-346f-4372-854e-b4b6ca4de7b5 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:18:20.352700 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f6d4172-644c-4964-8ecd-1d6ab9d9e319 None None] Sync routers for ids ['00920640-a6b6-40f1-9c3d-5d67417288d3'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:18:20.362672 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f6d4172-644c-4964-8ecd-1d6ab9d9e319 None None] Routers {'00920640-a6b6-40f1-9c3d-5d67417288d3'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:18:20.363298 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-4f6d4172-644c-4964-8ecd-1d6ab9d9e319 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7259f850>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:18:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['00920640-a6b6-40f1-9c3d-5d67417288d3'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:20.432348 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-72a02ca1-346f-4372-854e-b4b6ca4de7b5 admin admin] 10.222.0.68 "PUT /v2.0/routers/00920640-a6b6-40f1-9c3d-5d67417288d3/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6018713
Jun 01 10:18:20.434827 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40350) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:18:20.538090 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-4f6d4172-644c-4964-8ecd-1d6ab9d9e319 None None] Set router 00920640-a6b6-40f1-9c3d-5d67417288d3 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:18:20.611500 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2ba1d2c7-5d5d-431b-8748-3898be81ef29 admin admin] Notify callbacks [] for router, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:20.799953 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2ba1d2c7-5d5d-431b-8748-3898be81ef29 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:20.827507 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-4f6d4172-644c-4964-8ecd-1d6ab9d9e319 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7259f850>, [{'id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'name': 'tempest-TestVolumeBootPattern-871855271-router', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111'}], 'enable_snat': True}, 'gw_port_id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:17Z', 'updated_at': '2021-06-01T10:18:19Z', 'revision_number': 5, 'project_id': '1357a99c386544928f00bd66b4f5a21b', 'gw_port': {'id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:f1:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 409, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:18Z', 'updated_at': '2021-06-01T10:10:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:20.831267 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f6d4172-644c-4964-8ecd-1d6ab9d9e319 None None] Checking router: 00920640-a6b6-40f1-9c3d-5d67417288d3 for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:18:20.839483 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f6d4172-644c-4964-8ecd-1d6ab9d9e319 None None] Routers {'00920640-a6b6-40f1-9c3d-5d67417288d3'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:18:20.840079 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-4f6d4172-644c-4964-8ecd-1d6ab9d9e319 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7259f850>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:18:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['00920640-a6b6-40f1-9c3d-5d67417288d3'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:20.965405 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-2ba1d2c7-5d5d-431b-8748-3898be81ef29 admin admin] Deleting port 850b8fad-e68b-443d-a9a6-3468150f9715 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:18:20.965746 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2ba1d2c7-5d5d-431b-8748-3898be81ef29 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:21.016924 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-4f6d4172-644c-4964-8ecd-1d6ab9d9e319 None None] Set router 00920640-a6b6-40f1-9c3d-5d67417288d3 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:18:21.086068 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-2ba1d2c7-5d5d-431b-8748-3898be81ef29 admin admin] For port 850b8fad-e68b-443d-a9a6-3468150f9715, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=850b8fad-e68b-443d-a9a6-3468150f9715,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:18:21.086427 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2ba1d2c7-5d5d-431b-8748-3898be81ef29 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:21.214476 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-2ba1d2c7-5d5d-431b-8748-3898be81ef29 admin admin] Calling delete_port for 850b8fad-e68b-443d-a9a6-3468150f9715 owned by network:router_gateway {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:18:21.333730 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-4f6d4172-644c-4964-8ecd-1d6ab9d9e319 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7259f850>, [{'id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'name': 'tempest-TestVolumeBootPattern-871855271-router', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111'}], 'enable_snat': True}, 'gw_port_id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:17Z', 'updated_at': '2021-06-01T10:18:19Z', 'revision_number': 5, 'project_id': '1357a99c386544928f00bd66b4f5a21b', 'gw_port': {'id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:f1:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 409, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:18Z', 'updated_at': '2021-06-01T10:10:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:21.337615 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f6d4172-644c-4964-8ecd-1d6ab9d9e319 None None] The sync data for ids ['00920640-a6b6-40f1-9c3d-5d67417288d3'] in dv-cinder-787262-4-iscsi is: [{'id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'name': 'tempest-TestVolumeBootPattern-871855271-router', 'tenant_id': '1357a99c386544928f00bd66b4f5a21b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111'}], 'enable_snat': True}, 'gw_port_id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:10:17Z', 'updated_at': '2021-06-01T10:18:19Z', 'revision_number': 5, 'project_id': '1357a99c386544928f00bd66b4f5a21b', 'gw_port': {'id': '850b8fad-e68b-443d-a9a6-3468150f9715', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:f1:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00920640-a6b6-40f1-9c3d-5d67417288d3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 409, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:10:18Z', 'updated_at': '2021-06-01T10:10:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:18:21.431365 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2ba1d2c7-5d5d-431b-8748-3898be81ef29 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:21.435341 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-72a02ca1-346f-4372-854e-b4b6ca4de7b5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:21.479234 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ba1d2c7-5d5d-431b-8748-3898be81ef29 admin admin] Pushing event deleted for resources: {'Port': ['ID=850b8fad-e68b-443d-a9a6-3468150f9715,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:21.483161 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-2ba1d2c7-5d5d-431b-8748-3898be81ef29 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:21.683674 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2ba1d2c7-5d5d-431b-8748-3898be81ef29 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-403627'] for router_gateway, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:21.843428 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device f30fad44-c9e2-4619-8a3a-64a7a505f0a4 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:18:21.862995 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2ba1d2c7-5d5d-431b-8748-3898be81ef29 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-405542', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-15816'] for router, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:21.865568 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2ba1d2c7-5d5d-431b-8748-3898be81ef29 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:21.877724 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: f30fad44-c9e2-4619-8a3a-64a7a505f0a4 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:18:21.878077 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device f30fad44-c9e2-4619-8a3a-64a7a505f0a4 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:18:21.980058 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2ba1d2c7-5d5d-431b-8748-3898be81ef29 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-406042'] for router, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:21.980571 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2ba1d2c7-5d5d-431b-8748-3898be81ef29 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 00920640-a6b6-40f1-9c3d-5d67417288d3 {{(pid=92565) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 10:18:21.996030 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-2ba1d2c7-5d5d-431b-8748-3898be81ef29 admin admin] Notify callbacks [] for router, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:21.999527 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-2ba1d2c7-5d5d-431b-8748-3898be81ef29 admin admin] 10.222.0.68 "DELETE /v2.0/routers/00920640-a6b6-40f1-9c3d-5d67417288d3 HTTP/1.1" status: 204  len: 168 time: 1.5606415
Jun 01 10:18:21.999807 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40354) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:18:22.065067 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_v2 [None req-9ff97a45-2d71-4732-911d-f0782a45a5cb admin admin] Deleting subnet 600836e1-e1aa-4a90-94df-2b55cd865f86 {{(pid=92565) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 10:18:22.068207 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ff97a45-2d71-4732-911d-f0782a45a5cb admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:22.119293 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ff97a45-2d71-4732-911d-f0782a45a5cb admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2998467'] for subnet, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:22.198580 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ff97a45-2d71-4732-911d-f0782a45a5cb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7791835'] for subnet, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:22.521869 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ff97a45-2d71-4732-911d-f0782a45a5cb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7793006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2233195', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3139387'] for subnet, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:22.525817 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:22.560994 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ff97a45-2d71-4732-911d-f0782a45a5cb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=600836e1-e1aa-4a90-94df-2b55cd865f86,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:22.564179 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-9ff97a45-2d71-4732-911d-f0782a45a5cb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:22.565089 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-9ff97a45-2d71-4732-911d-f0782a45a5cb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:22.570411 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-def0d532-c3fe-43a0-a6c7-b05e23f616c7 None None] Network 0d72cce9-43d5-4d22-920b-062d8cfd9fb7 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:18:22.571553 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-9ff97a45-2d71-4732-911d-f0782a45a5cb admin admin] 10.222.0.68 "DELETE /v2.0/subnets/600836e1-e1aa-4a90-94df-2b55cd865f86 HTTP/1.1" status: 204  len: 168 time: 0.5708797
Jun 01 10:18:22.573865 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40358) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:18:22.681160 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7813807'] for network, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:22.761392 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] Deleting port 640cb80a-8969-4c0e-b9d6-f6e2acf57530 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:18:22.761744 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:22.819458 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49a6c6be-df84-42ed-9838-0d7267cf7d13 None None] DHCP port deletion for 0d72cce9-43d5-4d22-920b-062d8cfd9fb7 request from dv-cinder-787262-4-iscsi {{(pid=92567) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 10:18:22.866433 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] For port 640cb80a-8969-4c0e-b9d6-f6e2acf57530, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=640cb80a-8969-4c0e-b9d6-f6e2acf57530,segment=NetworkSegment(7e83dd0c-3be4-4412-8849-fe1a2cad78c1),segment_id=7e83dd0c-3be4-4412-8849-fe1a2cad78c1)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:18:22.867221 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:22.883187 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-49a6c6be-df84-42ed-9838-0d7267cf7d13 None None] Deleting port 640cb80a-8969-4c0e-b9d6-f6e2acf57530 {{(pid=92567) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:18:22.883715 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-49a6c6be-df84-42ed-9838-0d7267cf7d13 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:22.982789 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-49a6c6be-df84-42ed-9838-0d7267cf7d13 None None] For port 640cb80a-8969-4c0e-b9d6-f6e2acf57530, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=640cb80a-8969-4c0e-b9d6-f6e2acf57530,segment=NetworkSegment(7e83dd0c-3be4-4412-8849-fe1a2cad78c1),segment_id=7e83dd0c-3be4-4412-8849-fe1a2cad78c1)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:18:22.983152 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-49a6c6be-df84-42ed-9838-0d7267cf7d13 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:22.989852 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] Calling delete_port for 640cb80a-8969-4c0e-b9d6-f6e2acf57530 owned by network:dhcp {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:18:23.101970 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-49a6c6be-df84-42ed-9838-0d7267cf7d13 None None] Calling delete_port for 640cb80a-8969-4c0e-b9d6-f6e2acf57530 owned by network:dhcp {{(pid=92567) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:18:23.111222 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:23.116224 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c489ea3b-c881-4c05-86d9-1210c8c7b48a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:23.143698 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-49a6c6be-df84-42ed-9838-0d7267cf7d13 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820'] for port, after_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:23.147349 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7beff344-1bfb-4569-84cf-099411530e0e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:23.158464 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] Pushing event deleted for resources: {'Port': ['ID=640cb80a-8969-4c0e-b9d6-f6e2acf57530,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:23.161974 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:23.162854 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] No DVR routers for this DVR port 640cb80a-8969-4c0e-b9d6-f6e2acf57530 on host dv-cinder-787262-4-iscsi {{(pid=92565) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:18:23.192747 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49a6c6be-df84-42ed-9838-0d7267cf7d13 None None] Pushing event deleted for resources: {'Port': ['ID=640cb80a-8969-4c0e-b9d6-f6e2acf57530,revision_number=None']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:23.195720 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-49a6c6be-df84-42ed-9838-0d7267cf7d13 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:23.196506 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49a6c6be-df84-42ed-9838-0d7267cf7d13 None None] No DVR routers for this DVR port 640cb80a-8969-4c0e-b9d6-f6e2acf57530 on host dv-cinder-787262-4-iscsi {{(pid=92567) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:18:23.277701 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7795028', 'neutron.services.segments.db._delete_segments_for_network-8726958294492'] for network, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:23.294007 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7efe71eb3190>,) {'filters': {'network_id': ['0d72cce9-43d5-4d22-920b-062d8cfd9fb7']}} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:23.398463 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7efe71eb3190>, '7e83dd0c-3be4-4412-8849-fe1a2cad78c1') {'for_net_delete': True} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:23.398754 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7efe71eb3190>, '7e83dd0c-3be4-4412-8849-fe1a2cad78c1') {} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:18:23.411741 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726958303133', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2998472'] for segment, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:23.427310 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:23.433310 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] Releasing vlan 879 on physical network physnet1 to pool {{(pid=92565) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 10:18:23.433688 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2295757'] for segment, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]: Traceback (most recent call last):
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:     timer()
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:     cb(*args, **kw)
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:     return func(*args, **kwargs)
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:     self._notify()
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:     self.callback(batched_events)
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:     event.method(event)
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:     return f(self, *a, **k)
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._get(url).json()
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self.request(url, 'GET', **kwargs)
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 10:18:23.446450 dv-cinder-787262-4-iscsi neutron-server[92565]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 10:18:23.648293 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7795037', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-403638'] for network, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:23.652054 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-ac84967f-99e0-477f-b1cf-fa19673c5c8d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:23.666232 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:23.677041 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] Pushing event deleted for resources: {'Network': ['ID=0d72cce9-43d5-4d22-920b-062d8cfd9fb7,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:23.681567 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:23.684966 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-3e6d1eeb-e0d7-4b1d-8747-017993379366 admin admin] 10.222.0.68 "DELETE /v2.0/networks/0d72cce9-43d5-4d22-920b-062d8cfd9fb7 HTTP/1.1" status: 204  len: 168 time: 1.1102049
Jun 01 10:18:23.818846 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 640cb80a-8969-4c0e-b9d6-f6e2acf57530 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:18:23.861345 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: 640cb80a-8969-4c0e-b9d6-f6e2acf57530 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:18:23.861695 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 640cb80a-8969-4c0e-b9d6-f6e2acf57530 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:18:23.866277 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 850b8fad-e68b-443d-a9a6-3468150f9715 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:18:23.895300 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: 850b8fad-e68b-443d-a9a6-3468150f9715 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:18:23.896009 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 850b8fad-e68b-443d-a9a6-3468150f9715 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:18:24.037650 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40364) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:18:24.086746 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-dfd3e5ff-7ef5-4726-8321-5c9b111adcc9 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=cfa9132b1ba044548228b96f6c2755eb&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0477865
Jun 01 10:18:24.089100 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40368) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:18:24.147595 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-82bbeed3-b7bb-4bcb-89ff-c8b00f7de747 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:24.174049 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-82bbeed3-b7bb-4bcb-89ff-c8b00f7de747 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:24.295045 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-82bbeed3-b7bb-4bcb-89ff-c8b00f7de747 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:24.299027 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-b4eb3492-5324-4390-af52-b557f296e144 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:24.317507 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82bbeed3-b7bb-4bcb-89ff-c8b00f7de747 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=42eb0609-06e4-4793-b5e9-657f749cb27b,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:24.322289 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-82bbeed3-b7bb-4bcb-89ff-c8b00f7de747 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:24.326639 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-82bbeed3-b7bb-4bcb-89ff-c8b00f7de747 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:24.327501 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-82bbeed3-b7bb-4bcb-89ff-c8b00f7de747 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/42eb0609-06e4-4793-b5e9-657f749cb27b HTTP/1.1" status: 204  len: 168 time: 0.2374947
Jun 01 10:18:24.955377 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 40378) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:18:25.004407 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-e2bd755f-df91-4b9e-930d-aca6178adaa0 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=1357a99c386544928f00bd66b4f5a21b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0478415
Jun 01 10:18:25.006778 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 40382) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:18:25.066578 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-d684ba09-ddc7-46a9-bfa5-8581cc813608 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:25.092481 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-d684ba09-ddc7-46a9-bfa5-8581cc813608 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:25.225660 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-d684ba09-ddc7-46a9-bfa5-8581cc813608 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:25.229702 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-b155e7c0-a7af-4fc6-9ccd-65094c260f4d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:25.242117 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d684ba09-ddc7-46a9-bfa5-8581cc813608 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2baf22e-e911-4f2f-84b7-a8c1dc6945a3,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:25.246030 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-d684ba09-ddc7-46a9-bfa5-8581cc813608 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:25.249221 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-d684ba09-ddc7-46a9-bfa5-8581cc813608 admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:25.250318 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-d684ba09-ddc7-46a9-bfa5-8581cc813608 admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/d2baf22e-e911-4f2f-84b7-a8c1dc6945a3 HTTP/1.1" status: 204  len: 168 time: 0.2426322
Jun 01 10:18:26.551392 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:27.248621 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-eafab791-9799-43c3-bcf1-bd676f46fd8c req-e80e6e6a-77bd-45bb-94c2-4438515e03c9 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0707834
Jun 01 10:18:27.405949 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eafab791-9799-43c3-bcf1-bd676f46fd8c req-6ce50567-77ff-4222-b999-48a26a18ec44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:27.407455 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-eafab791-9799-43c3-bcf1-bd676f46fd8c req-6ce50567-77ff-4222-b999-48a26a18ec44 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=471ae02220fb428c836d64a2bb2bcb76&device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 1099 time: 0.0800941
Jun 01 10:18:27.559929 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eafab791-9799-43c3-bcf1-bd676f46fd8c req-35be5761-3f98-479f-a390-cb633278a667 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:27.561318 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-eafab791-9799-43c3-bcf1-bd676f46fd8c req-35be5761-3f98-479f-a390-cb633278a667 service neutron] 10.222.0.30 "GET /v2.0/networks?id=5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 HTTP/1.1" status: 200  len: 910 time: 0.1277819
Jun 01 10:18:27.670846 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-eafab791-9799-43c3-bcf1-bd676f46fd8c req-9030d718-36e6-4e2b-9c7e-cbefbca5e14f service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a7c8635b-7446-4fde-9653-ce439be1b0e2 HTTP/1.1" status: 200  len: 1002 time: 0.0995498
Jun 01 10:18:27.735731 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eafab791-9799-43c3-bcf1-bd676f46fd8c req-6ac52266-5a9c-4a89-9e9a-5df085f726c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:27.737143 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-eafab791-9799-43c3-bcf1-bd676f46fd8c req-6ac52266-5a9c-4a89-9e9a-5df085f726c7 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=24404399-0c0c-45bf-839e-f86b0f5c30d7 HTTP/1.1" status: 200  len: 848 time: 0.0568550
Jun 01 10:18:27.816232 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eafab791-9799-43c3-bcf1-bd676f46fd8c req-b74fa3d9-01a7-4777-91e6-db8c92cff724 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:27.817263 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-eafab791-9799-43c3-bcf1-bd676f46fd8c req-b74fa3d9-01a7-4777-91e6-db8c92cff724 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0699496
Jun 01 10:18:27.951647 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-eafab791-9799-43c3-bcf1-bd676f46fd8c req-310ec051-6620-407e-9eb5-4bee963f4a50 service neutron] 10.222.0.30 "GET /v2.0/networks/5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1258144
Jun 01 10:18:28.083589 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-eafab791-9799-43c3-bcf1-bd676f46fd8c req-b5cbda40-a8b6-4f2b-88bf-4e1b5291d64e service neutron] 10.222.0.30 "GET /v2.0/networks/5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1216700
Jun 01 10:18:36.465728 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:18:38.214953 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138bcd8c-bf70-41fc-bdd8-87969c8d0433 req-37a72e3e-6681-4912-a486-80f151b7597a tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:38.217215 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-138bcd8c-bf70-41fc-bdd8-87969c8d0433 req-37a72e3e-6681-4912-a486-80f151b7597a tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0893805
Jun 01 10:18:38.262613 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-138bcd8c-bf70-41fc-bdd8-87969c8d0433 req-f5d1911a-040e-4a84-b958-4acbe360fd0d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391343
Jun 01 10:18:39.447379 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4fa096e-6436-4614-89cf-7e5deab28ed8 req-5ca356da-9898-46bf-a21c-352fc276cf57 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:39.448851 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b4fa096e-6436-4614-89cf-7e5deab28ed8 req-5ca356da-9898-46bf-a21c-352fc276cf57 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0821559
Jun 01 10:18:39.496899 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b4fa096e-6436-4614-89cf-7e5deab28ed8 req-ab021bf7-abca-4326-98bd-3b82b34c0c49 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0422716
Jun 01 10:18:40.504021 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-de766095-035f-4100-95c3-a14534434477 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:40.680947 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-977db116-edab-458e-83e4-b18331860f50 req-2b1218b5-66b6-4bf9-b32c-266e76bd0a0b tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:40.682396 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-977db116-edab-458e-83e4-b18331860f50 req-2b1218b5-66b6-4bf9-b32c-266e76bd0a0b tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0793333
Jun 01 10:18:40.726022 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-977db116-edab-458e-83e4-b18331860f50 req-99a6d4a2-b931-4e28-b0dd-3171fe8536c0 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0374465
Jun 01 10:18:41.913716 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7caf8d5d-1582-4dc9-a28f-9b0db5a2e98a req-8437286e-2f8c-4f46-99de-6efa29e0394e tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:41.915180 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7caf8d5d-1582-4dc9-a28f-9b0db5a2e98a req-8437286e-2f8c-4f46-99de-6efa29e0394e tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0811074
Jun 01 10:18:42.044829 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-7caf8d5d-1582-4dc9-a28f-9b0db5a2e98a req-3f575a5e-2dfd-4fbc-8e49-169000bcf51a tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1239448
Jun 01 10:18:42.979826 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-a4fda155-bcad-4083-b531-0f8a043295ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:43.239261 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9309d6f-7ed4-47bb-b5ed-be0ee6981425 req-53a02a45-1422-448f-9258-ecbc76fb1623 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:43.240720 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b9309d6f-7ed4-47bb-b5ed-be0ee6981425 req-53a02a45-1422-448f-9258-ecbc76fb1623 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0906410
Jun 01 10:18:43.259722 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:43.295697 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b9309d6f-7ed4-47bb-b5ed-be0ee6981425 req-07b1f32f-9857-4cc7-8fda-bfec0c010399 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0491107
Jun 01 10:18:44.071122 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:44.477961 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3705e81-6d31-459e-9a48-6c72eb9979bc req-843c3dd6-0c82-4600-8c9c-820063de639c tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:44.479427 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d3705e81-6d31-459e-9a48-6c72eb9979bc req-843c3dd6-0c82-4600-8c9c-820063de639c tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0789690
Jun 01 10:18:44.523533 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d3705e81-6d31-459e-9a48-6c72eb9979bc req-3cf8e2e5-7ea4-44a6-bfe4-edb1bc2a2abe tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0380316
Jun 01 10:18:45.710236 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5530e07-f3a2-40eb-909c-2acebb59250f req-9f9663fc-d992-4bec-8f3d-773787912a7a tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:45.711701 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f5530e07-f3a2-40eb-909c-2acebb59250f req-9f9663fc-d992-4bec-8f3d-773787912a7a tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0842876
Jun 01 10:18:45.758016 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f5530e07-f3a2-40eb-909c-2acebb59250f req-b91777ce-5571-4662-bb86-26661eb56234 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406375
Jun 01 10:18:45.841386 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:46.945838 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c96a2a5a-1c56-4fab-a52c-d7739a4b279b req-294c2919-cc74-4e69-9a4c-29d8132ed220 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:46.947381 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c96a2a5a-1c56-4fab-a52c-d7739a4b279b req-294c2919-cc74-4e69-9a4c-29d8132ed220 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0821824
Jun 01 10:18:46.991498 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c96a2a5a-1c56-4fab-a52c-d7739a4b279b req-d58e3949-e536-435c-8c6b-eef787d3e0b5 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385079
Jun 01 10:18:48.179363 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37f956c-324f-4e0d-b082-38b691b1b56c req-a4f0a95c-3818-4b14-bbe4-cfe90fee78e5 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:48.180797 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c37f956c-324f-4e0d-b082-38b691b1b56c req-a4f0a95c-3818-4b14-bbe4-cfe90fee78e5 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0831921
Jun 01 10:18:48.223883 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c37f956c-324f-4e0d-b082-38b691b1b56c req-04f0a137-473d-483a-90b8-17a4860b69eb tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0372074
Jun 01 10:18:48.420678 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54f98ef1-6e84-4dae-b9fb-965a56e6a4dd req-f92e53c6-e3a2-4169-9077-c4aac5b214c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:48.422802 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-54f98ef1-6e84-4dae-b9fb-965a56e6a4dd req-f92e53c6-e3a2-4169-9077-c4aac5b214c4 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=471ae02220fb428c836d64a2bb2bcb76&device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 1099 time: 0.0713649
Jun 01 10:18:48.557196 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54f98ef1-6e84-4dae-b9fb-965a56e6a4dd req-8041ef57-27c3-4139-9a7a-9ac276d6e8d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:48.558637 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-54f98ef1-6e84-4dae-b9fb-965a56e6a4dd req-8041ef57-27c3-4139-9a7a-9ac276d6e8d9 service neutron] 10.222.0.30 "GET /v2.0/networks?id=5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 HTTP/1.1" status: 200  len: 910 time: 0.1254771
Jun 01 10:18:48.664440 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-54f98ef1-6e84-4dae-b9fb-965a56e6a4dd req-ae5cad8e-e779-4abe-a7d2-f1ec3308a6dc service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a7c8635b-7446-4fde-9653-ce439be1b0e2 HTTP/1.1" status: 200  len: 1002 time: 0.0949345
Jun 01 10:18:48.732354 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54f98ef1-6e84-4dae-b9fb-965a56e6a4dd req-5b647617-b263-48ae-8583-004b90990e1e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:48.733767 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-54f98ef1-6e84-4dae-b9fb-965a56e6a4dd req-5b647617-b263-48ae-8583-004b90990e1e service neutron] 10.222.0.30 "GET /v2.0/subnets?id=24404399-0c0c-45bf-839e-f86b0f5c30d7 HTTP/1.1" status: 200  len: 848 time: 0.0595365
Jun 01 10:18:48.812817 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54f98ef1-6e84-4dae-b9fb-965a56e6a4dd req-943683dc-e14e-4f53-862a-4606d44bc3b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:48.814851 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-54f98ef1-6e84-4dae-b9fb-965a56e6a4dd req-943683dc-e14e-4f53-862a-4606d44bc3b8 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0712376
Jun 01 10:18:48.948696 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-54f98ef1-6e84-4dae-b9fb-965a56e6a4dd req-90d72601-61aa-448f-a9ec-0c67c45250a4 service neutron] 10.222.0.30 "GET /v2.0/networks/5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1238706
Jun 01 10:18:49.089718 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-54f98ef1-6e84-4dae-b9fb-965a56e6a4dd req-58d3fee7-bfb6-435f-81ba-a2bf4f6cb31e service neutron] 10.222.0.30 "GET /v2.0/networks/5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1310580
Jun 01 10:18:49.405762 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac484866-55c7-4156-b58a-f624c8d779f2 req-fda83ecd-b445-45af-90cc-56f382f3a32f tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:49.407120 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac484866-55c7-4156-b58a-f624c8d779f2 req-fda83ecd-b445-45af-90cc-56f382f3a32f tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0775020
Jun 01 10:18:49.453857 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ac484866-55c7-4156-b58a-f624c8d779f2 req-acded1a8-68f2-44a4-a1d6-1b2b0534b797 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406497
Jun 01 10:18:50.642761 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75c42123-924b-4fcd-abb3-a6892fffe6b9 req-1c15f99f-c20b-439f-9170-a650c73dc579 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:50.644243 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-75c42123-924b-4fcd-abb3-a6892fffe6b9 req-1c15f99f-c20b-439f-9170-a650c73dc579 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0833290
Jun 01 10:18:50.688316 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-75c42123-924b-4fcd-abb3-a6892fffe6b9 req-58ab83cb-c337-46c5-a16f-aee081689804 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0384846
Jun 01 10:18:51.875965 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81626a1-5484-42ca-ae59-d0922c7e9911 req-671d1556-f373-4a4f-83db-aadca1c23c81 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:51.878065 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c81626a1-5484-42ca-ae59-d0922c7e9911 req-671d1556-f373-4a4f-83db-aadca1c23c81 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0848386
Jun 01 10:18:51.931455 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-c81626a1-5484-42ca-ae59-d0922c7e9911 req-7bbb617e-e6d1-4a65-8af4-d085057ef7b0 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0475807
Jun 01 10:18:53.111324 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7dea619-bc63-4643-a469-488850f6ddf4 req-8cc0dfee-0e14-4371-b668-926bfe7f2b52 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:53.112666 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f7dea619-bc63-4643-a469-488850f6ddf4 req-8cc0dfee-0e14-4371-b668-926bfe7f2b52 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0792310
Jun 01 10:18:53.156864 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f7dea619-bc63-4643-a469-488850f6ddf4 req-0853c2bc-370b-4d08-908c-ac58712d9c02 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0382235
Jun 01 10:18:53.745963 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84c40c2f-0d70-4320-bf7a-8782d8ee3991 req-01a05f59-68e6-4dd1-ace0-b479c71a4d59 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:53.747386 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-84c40c2f-0d70-4320-bf7a-8782d8ee3991 req-01a05f59-68e6-4dd1-ace0-b479c71a4d59 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.1755462
Jun 01 10:18:53.770142 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 40424) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:18:53.797956 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-84c40c2f-0d70-4320-bf7a-8782d8ee3991 req-137c3bb3-7b9e-4e62-98f0-46abc03e2342 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0446980
Jun 01 10:18:53.890249 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8ce35860-4bb8-4b3e-8cd5-b7996b06ad9c req-8a2ef2c7-24c8-40e2-a1b6-f68e1676dcf8 service neutron] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1189775
Jun 01 10:18:55.054500 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device a7c8635b-7446-4fde-9653-ce439be1b0e2 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:18:55.136246 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3258c3c-fe51-4c66-b55e-b521cd992d14 req-f3a2624b-e385-4473-9c24-76b459388b83 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:55.137769 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e3258c3c-fe51-4c66-b55e-b521cd992d14 req-f3a2624b-e385-4473-9c24-76b459388b83 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0876789
Jun 01 10:18:55.166784 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:55.183089 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e3258c3c-fe51-4c66-b55e-b521cd992d14 req-2a51ccef-b1b7-40f2-a2d9-efc73eb83c6b tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397429
Jun 01 10:18:55.196097 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a7c8635b-7446-4fde-9653-ce439be1b0e2'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:18:55.198303 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-de353342-a793-4c02-850b-e6cdef5baa8c" -d '{"events": [{"server_uuid": "a86bd86c-a7bc-459a-9733-8b31623ad03c", "name": "network-vif-unplugged", "status": "completed", "tag": "a7c8635b-7446-4fde-9653-ce439be1b0e2"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:18:55.205659 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port a7c8635b-7446-4fde-9653-ce439be1b0e2, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=a7c8635b-7446-4fde-9653-ce439be1b0e2,segment=NetworkSegment(e26992f8-9861-4fb0-83e9-200e0276045e),segment_id=e26992f8-9861-4fb0-83e9-200e0276045e)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:18:55.259989 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:55.261964 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-356fa685-99b1-4142-b830-b92accd87485 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:18:55.329049 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=a7c8635b-7446-4fde-9653-ce439be1b0e2,revision_number=6']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:18:55.332562 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:18:55.364932 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 01 Jun 2021 10:18:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dc3082f9-429e-4dc4-8b0e-01433b37b8be x-openstack-request-id: req-dc3082f9-429e-4dc4-8b0e-01433b37b8be {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:18:55.365232 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a86bd86c-a7bc-459a-9733-8b31623ad03c", "name": "network-vif-unplugged", "status": "failed", "tag": "a7c8635b-7446-4fde-9653-ce439be1b0e2", "code": 422}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:18:55.365514 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-dc3082f9-429e-4dc4-8b0e-01433b37b8be {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:18:55.367604 dv-cinder-787262-4-iscsi neutron-server[92567]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'a7c8635b-7446-4fde-9653-ce439be1b0e2', 'code': 422} returned with failed status
Jun 01 10:18:56.380663 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53243e66-a742-40b6-b658-c09a7e54c48f req-bba10bc2-8cba-4e94-85a7-8f7bdfbd7e68 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:56.382139 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-53243e66-a742-40b6-b658-c09a7e54c48f req-bba10bc2-8cba-4e94-85a7-8f7bdfbd7e68 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 944 time: 0.0889795
Jun 01 10:18:56.429432 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-53243e66-a742-40b6-b658-c09a7e54c48f req-06554163-3433-4bd2-a33a-fa2825cdc3bb tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0415378
Jun 01 10:18:56.566805 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:18:56.772179 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce35860-4bb8-4b3e-8cd5-b7996b06ad9c req-0a41f758-c41c-4b2e-bab7-4b2689cc3c88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:56.773683 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8ce35860-4bb8-4b3e-8cd5-b7996b06ad9c req-0a41f758-c41c-4b2e-bab7-4b2689cc3c88 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c&tenant_id=471ae02220fb428c836d64a2bb2bcb76 HTTP/1.1" status: 200  len: 1097 time: 0.0706875
Jun 01 10:18:56.872142 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce35860-4bb8-4b3e-8cd5-b7996b06ad9c req-e2d34e5a-2cd9-4323-9056-9b669163f413 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:56.873499 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8ce35860-4bb8-4b3e-8cd5-b7996b06ad9c req-e2d34e5a-2cd9-4323-9056-9b669163f413 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=471ae02220fb428c836d64a2bb2bcb76&device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 1097 time: 0.0715690
Jun 01 10:18:57.010070 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce35860-4bb8-4b3e-8cd5-b7996b06ad9c req-1f37d75d-356d-4d55-8804-c159ab68bca4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:57.011523 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8ce35860-4bb8-4b3e-8cd5-b7996b06ad9c req-1f37d75d-356d-4d55-8804-c159ab68bca4 service neutron] 10.222.0.30 "GET /v2.0/networks?id=5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 HTTP/1.1" status: 200  len: 910 time: 0.1278336
Jun 01 10:18:57.118387 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8ce35860-4bb8-4b3e-8cd5-b7996b06ad9c req-fb1e27d1-1618-4d20-9c19-cd65331a9d0f service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a7c8635b-7446-4fde-9653-ce439be1b0e2 HTTP/1.1" status: 200  len: 1000 time: 0.0961764
Jun 01 10:18:57.186173 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce35860-4bb8-4b3e-8cd5-b7996b06ad9c req-b2c87355-a5dd-4629-8fee-c0bb7a0bb949 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:57.187611 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8ce35860-4bb8-4b3e-8cd5-b7996b06ad9c req-b2c87355-a5dd-4629-8fee-c0bb7a0bb949 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=24404399-0c0c-45bf-839e-f86b0f5c30d7 HTTP/1.1" status: 200  len: 848 time: 0.0593305
Jun 01 10:18:57.265379 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce35860-4bb8-4b3e-8cd5-b7996b06ad9c req-1b549bcd-8cd0-4e21-9706-02231c48302d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:57.266822 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8ce35860-4bb8-4b3e-8cd5-b7996b06ad9c req-1b549bcd-8cd0-4e21-9706-02231c48302d service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0687075
Jun 01 10:18:57.400868 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8ce35860-4bb8-4b3e-8cd5-b7996b06ad9c req-fc0c4662-e7c9-48d1-b378-d2619851ee3e service neutron] 10.222.0.30 "GET /v2.0/networks/5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1230431
Jun 01 10:18:57.574478 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8ce35860-4bb8-4b3e-8cd5-b7996b06ad9c req-6c4ed06d-42e3-4566-b95d-997464efb79a service neutron] 10.222.0.30 "GET /v2.0/networks/5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1631424
Jun 01 10:18:57.617192 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fd52696-1853-42d6-b476-b10da5f63e5c req-e9fa3d8d-83f0-4852-9ac2-199f2790fa66 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:57.618670 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0fd52696-1853-42d6-b476-b10da5f63e5c req-e9fa3d8d-83f0-4852-9ac2-199f2790fa66 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 944 time: 0.0845551
Jun 01 10:18:57.666974 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-0fd52696-1853-42d6-b476-b10da5f63e5c req-e10fb086-a44f-4200-a4e6-114e29d14d5c tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0426338
Jun 01 10:18:58.851893 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03df9b62-4dca-4965-bf93-cee538734d9c req-717cf386-19f4-4f43-abe8-b7b02705baa3 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:18:58.853369 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-03df9b62-4dca-4965-bf93-cee538734d9c req-717cf386-19f4-4f43-abe8-b7b02705baa3 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 944 time: 0.0823383
Jun 01 10:18:58.897448 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-03df9b62-4dca-4965-bf93-cee538734d9c req-23afa701-236c-4cc5-bfb5-d8855e0529e1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0381663
Jun 01 10:19:00.085768 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09045be1-d6e4-418a-a0a9-95963cfa77e6 req-3434c728-fcdd-410d-b09d-98a775540cee tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:19:00.087155 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-09045be1-d6e4-418a-a0a9-95963cfa77e6 req-3434c728-fcdd-410d-b09d-98a775540cee tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 944 time: 0.0827971
Jun 01 10:19:00.132357 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-09045be1-d6e4-418a-a0a9-95963cfa77e6 req-9554fa66-dd09-41c3-bef3-8477ddab1e51 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0396023
Jun 01 10:19:01.318224 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fa826f0-6649-412f-9b55-91c5b75f002d req-edc1a5a5-b6c2-43ad-ae67-49f716365663 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:19:01.319721 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6fa826f0-6649-412f-9b55-91c5b75f002d req-edc1a5a5-b6c2-43ad-ae67-49f716365663 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 944 time: 0.0809567
Jun 01 10:19:01.364019 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6fa826f0-6649-412f-9b55-91c5b75f002d req-164aff7a-eaae-4f59-8dc8-ea11a87929ed tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0382056
Jun 01 10:19:02.550169 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2af578d4-0fc8-4288-a033-2e2d42bb5185 req-e19df231-0ef0-4236-ad61-a75c0d9cf01f tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:19:02.551631 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2af578d4-0fc8-4288-a033-2e2d42bb5185 req-e19df231-0ef0-4236-ad61-a75c0d9cf01f tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 944 time: 0.0828164
Jun 01 10:19:02.594562 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-2af578d4-0fc8-4288-a033-2e2d42bb5185 req-40b77b29-6b50-42af-a1d4-fc4ca92ebe06 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0373659
Jun 01 10:19:03.777651 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb84125-643c-4ce8-a96d-20761a12b2d7 req-3a698929-962e-444d-b5e6-66bab20f823d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:19:03.779128 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8fb84125-643c-4ce8-a96d-20761a12b2d7 req-3a698929-962e-444d-b5e6-66bab20f823d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 944 time: 0.0802979
Jun 01 10:19:03.827507 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-8fb84125-643c-4ce8-a96d-20761a12b2d7 req-9a4ee6c5-2cb3-4c1e-93a0-ab5c1c266845 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0427179
Jun 01 10:19:05.010572 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f25a1e75-c52b-4ba3-8333-b6c9954a724b req-85989c01-a12c-4906-9a3d-f0407574da4e tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:19:05.012285 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f25a1e75-c52b-4ba3-8333-b6c9954a724b req-85989c01-a12c-4906-9a3d-f0407574da4e tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 944 time: 0.0816689
Jun 01 10:19:05.056410 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f25a1e75-c52b-4ba3-8333-b6c9954a724b req-23d228fb-11e8-49fc-b6c8-7ca66610bd7e tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385523
Jun 01 10:19:05.117228 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device a7c8635b-7446-4fde-9653-ce439be1b0e2 details requested by agent hyperv_hv-cinder-78726 with host hv-cinder-78726 {{(pid=92567) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 10:19:05.251286 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port a7c8635b-7446-4fde-9653-ce439be1b0e2, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=a7c8635b-7446-4fde-9653-ce439be1b0e2,segment=NetworkSegment(e26992f8-9861-4fb0-83e9-200e0276045e),segment_id=e26992f8-9861-4fb0-83e9-200e0276045e)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:19:05.264850 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Returning: {'device': 'a7c8635b-7446-4fde-9653-ce439be1b0e2', 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'port_id': 'a7c8635b-7446-4fde-9653-ce439be1b0e2', 'mac_address': 'fa:16:3e:e4:c5:50', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 895, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=92567) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 10:19:05.322414 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:19:05.338845 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a7c8635b-7446-4fde-9653-ce439be1b0e2 {{(pid=92567) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 10:19:05.353640 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port a7c8635b-7446-4fde-9653-ce439be1b0e2, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=a7c8635b-7446-4fde-9653-ce439be1b0e2,segment=NetworkSegment(e26992f8-9861-4fb0-83e9-200e0276045e),segment_id=e26992f8-9861-4fb0-83e9-200e0276045e)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:19:05.442598 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:19:05.445312 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-c5b6ee0f-ec1d-485c-8d7f-ee41dab9cb47 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:19:05.509658 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=a7c8635b-7446-4fde-9653-ce439be1b0e2,revision_number=7']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:19:05.512744 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:19:05.703046 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] get_ports_and_sgs() called for port_ids ['a7c8635b-7446-4fde-9653-ce439be1b0e2'] {{(pid=92567) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 10:19:06.347801 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6e52df9-7bd9-48cb-9441-65c92287ba1f req-8beb42c2-8513-4c8c-8400-03c7d8f8069d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:19:06.349212 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d6e52df9-7bd9-48cb-9441-65c92287ba1f req-8beb42c2-8513-4c8c-8400-03c7d8f8069d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 945 time: 0.1713440
Jun 01 10:19:06.393191 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-d6e52df9-7bd9-48cb-9441-65c92287ba1f req-c99940c8-cedd-4c4b-950d-0409de0dbae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0382798
Jun 01 10:19:07.132113 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device a7c8635b-7446-4fde-9653-ce439be1b0e2 up at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 10:19:07.231638 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.provisioning_blocks [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Provisioning complete for port a7c8635b-7446-4fde-9653-ce439be1b0e2 triggered by entity L2. {{(pid=92567) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 10:19:07.232016 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-7797025'] for port, provisioning_complete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:19:07.348471 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-7848215'] for port, before_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:19:07.374048 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a7c8635b-7446-4fde-9653-ce439be1b0e2'}] {{(pid=92567) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:19:07.376273 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}367c5543d146a65b813dc38044bf2d436145c498ed44749625a0d8704cbae4a5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e09e378b-49b5-4fe2-915b-db3e8813cf9e" -d '{"events": [{"server_uuid": "a86bd86c-a7bc-459a-9733-8b31623ad03c", "name": "network-vif-plugged", "status": "completed", "tag": "a7c8635b-7446-4fde-9653-ce439be1b0e2"}]}' {{(pid=92567) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:19:07.384183 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] For port a7c8635b-7446-4fde-9653-ce439be1b0e2, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=a7c8635b-7446-4fde-9653-ce439be1b0e2,segment=NetworkSegment(e26992f8-9861-4fb0-83e9-200e0276045e),segment_id=e26992f8-9861-4fb0-83e9-200e0276045e)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:19:07.418994 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:19:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-08aafc17-9742-42c6-91c9-f7d5277e2d80 x-openstack-request-id: req-08aafc17-9742-42c6-91c9-f7d5277e2d80 {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:19:07.419292 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a86bd86c-a7bc-459a-9733-8b31623ad03c", "name": "network-vif-plugged", "status": "completed", "tag": "a7c8635b-7446-4fde-9653-ce439be1b0e2", "code": 200}]} {{(pid=92567) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:19:07.419552 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-08aafc17-9742-42c6-91c9-f7d5277e2d80 {{(pid=92567) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:19:07.419952 dv-cinder-787262-4-iscsi neutron-server[92567]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a7c8635b-7446-4fde-9653-ce439be1b0e2', 'code': 200}
Jun 01 10:19:07.465564 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726958284436', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726957849829', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726957850390'] for port, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:19:07.467382 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-d5e73eee-88ca-4b1a-bc47-37bee78d9084 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:19:07.533410 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Pushing event updated for resources: {'Port': ['ID=a7c8635b-7446-4fde-9653-ce439be1b0e2,revision_number=8']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:19:07.536798 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:19:07.582605 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddf07624-a063-4b08-893d-5ab355e5170b req-1dc465d0-fab8-4030-9050-81df3fe1d022 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:19:07.584168 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddf07624-a063-4b08-893d-5ab355e5170b req-1dc465d0-fab8-4030-9050-81df3fe1d022 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0845819
Jun 01 10:19:07.638994 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-ddf07624-a063-4b08-893d-5ab355e5170b req-bdd7d38d-36f1-467a-90d6-07002eb42add tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0491505
Jun 01 10:19:07.786459 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faa8cc59-5ded-4dae-821d-84e70377d080 req-d4f4fb9b-f094-4db5-b7c3-b6386466762a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:19:07.787951 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-faa8cc59-5ded-4dae-821d-84e70377d080 req-d4f4fb9b-f094-4db5-b7c3-b6386466762a service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 1099 time: 0.0700221
Jun 01 10:19:07.832702 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-faa8cc59-5ded-4dae-821d-84e70377d080 req-d0bae082-6c31-4993-bfa8-a04b7c1813d9 service neutron] 10.222.0.30 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0351644
Jun 01 10:19:08.834156 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ade02a-1205-44af-a9da-4984ee9cd969 req-ee034af8-b400-4bd6-9e96-1812de450ba5 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:19:08.835760 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-72ade02a-1205-44af-a9da-4984ee9cd969 req-ee034af8-b400-4bd6-9e96-1812de450ba5 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0866730
Jun 01 10:19:08.880871 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-72ade02a-1205-44af-a9da-4984ee9cd969 req-2b197860-c952-4ac5-b2df-13264ceb3a39 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0393605
Jun 01 10:19:10.063224 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6719f008-e350-4b2b-af1e-d97095a75afc req-e7c14478-8a54-475e-8306-85d518713e85 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:19:10.064598 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6719f008-e350-4b2b-af1e-d97095a75afc req-e7c14478-8a54-475e-8306-85d518713e85 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.0800672
Jun 01 10:19:10.109655 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-6719f008-e350-4b2b-af1e-d97095a75afc req-a7b456fe-dcc7-437d-8cf1-a7c84f93a556 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0389783
Jun 01 10:19:10.476709 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-64f75b95-72de-4c15-a1bc-8c5b0fc8bdc2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:19:12.939390 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-04865594-b89d-4e68-bdbb-69f80c4f84d0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:19:13.276647 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:19:13.464787 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:19:14.144597 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:19:15.807868 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:19:26.550922 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:19:29.258393 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-be762e35-cb81-4436-b621-165971505f50 req-377b6891-ecc6-452a-a76a-c844e33648a1 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0723445
Jun 01 10:19:29.400684 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be762e35-cb81-4436-b621-165971505f50 req-a070e2ad-bb34-42d4-a951-120bda03e383 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:19:29.402147 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-be762e35-cb81-4436-b621-165971505f50 req-a070e2ad-bb34-42d4-a951-120bda03e383 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=471ae02220fb428c836d64a2bb2bcb76&device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 1099 time: 0.0719812
Jun 01 10:19:29.547557 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be762e35-cb81-4436-b621-165971505f50 req-2fd28556-e567-4621-9efb-65f0ad4d90ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:19:29.548922 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-be762e35-cb81-4436-b621-165971505f50 req-2fd28556-e567-4621-9efb-65f0ad4d90ee service neutron] 10.222.0.30 "GET /v2.0/networks?id=5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 HTTP/1.1" status: 200  len: 910 time: 0.1256931
Jun 01 10:19:29.663388 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-be762e35-cb81-4436-b621-165971505f50 req-76116b5b-968e-4bf4-b018-deea1b67ef83 service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a7c8635b-7446-4fde-9653-ce439be1b0e2 HTTP/1.1" status: 200  len: 1002 time: 0.1065586
Jun 01 10:19:29.731504 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be762e35-cb81-4436-b621-165971505f50 req-21d5049e-3d28-4516-a6bd-f664a8dfd46a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:19:29.732921 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-be762e35-cb81-4436-b621-165971505f50 req-21d5049e-3d28-4516-a6bd-f664a8dfd46a service neutron] 10.222.0.30 "GET /v2.0/subnets?id=24404399-0c0c-45bf-839e-f86b0f5c30d7 HTTP/1.1" status: 200  len: 848 time: 0.0595384
Jun 01 10:19:29.809364 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be762e35-cb81-4436-b621-165971505f50 req-b44103cd-ea41-49b7-8972-bed0af692482 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:19:29.810888 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-be762e35-cb81-4436-b621-165971505f50 req-b44103cd-ea41-49b7-8972-bed0af692482 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0702243
Jun 01 10:19:29.945527 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-be762e35-cb81-4436-b621-165971505f50 req-75029a28-7aa7-4aae-9887-2248e158fd49 service neutron] 10.222.0.30 "GET /v2.0/networks/5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1267657
Jun 01 10:19:30.078984 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-be762e35-cb81-4436-b621-165971505f50 req-ed76d769-2646-4766-8bcc-4a1655b73e55 service neutron] 10.222.0.30 "GET /v2.0/networks/5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1257596
Jun 01 10:19:40.488128 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-46de26f8-ca13-40df-9233-309c820559f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:19:42.950427 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-a8ecd9ae-252d-4547-bd84-0c0ffa77416d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:19:43.236472 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:19:44.065090 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:19:45.807911 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:19:50.463751 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:19:56.579250 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:10.499302 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-599393f1-1001-4931-a866-5c5991340446 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:12.944817 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-f1c9fc83-79b8-447d-84ea-b22440973723 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:13.247927 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:14.053667 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:15.852561 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:23.147785 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 40482) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:20:23.408468 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Deleting port 2b820418-9b14-4441-bd23-7d11c9d0a5e3 {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:20:23.408726 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:23.618538 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:23.618858 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:23.736567 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Calling delete_port for 2b820418-9b14-4441-bd23-7d11c9d0a5e3 owned by network:floatingip {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:20:23.921986 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:23.925986 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-45cd3695-9d4c-4a5f-9624-24ba6ed914f9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:20:23.969323 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Pushing event deleted for resources: {'Port': ['ID=2b820418-9b14-4441-bd23-7d11c9d0a5e3,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:20:24.006179 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:24.006526 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:24.006808 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:24.007186 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:24.007535 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:24.007882 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:24.008226 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:24.008572 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:24.008909 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:24.009253 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:24.009592 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:24.009932 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92566) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:24.025476 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:20:24.077892 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for floatingip, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:24.078223 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.db.l3_db [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Floating IP 3b4b3cb8-6693-4b49-a498-ac7276af85e9 disassociated (deleted). External IP: 172.27.2.211, port: a7c8635b-7446-4fde-9653-ce439be1b0e2.
Jun 01 10:20:24.423445 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Router ab86be34-7347-42c9-9bdf-c507ef094164 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92566) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:20:24.603223 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92566) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:20:24.612277 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93b37ddc-d37e-4a0a-a704-03d9c1c94ad6 None None] Sync routers for ids ['ab86be34-7347-42c9-9bdf-c507ef094164'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:20:24.622119 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93b37ddc-d37e-4a0a-a704-03d9c1c94ad6 None None] Routers {'ab86be34-7347-42c9-9bdf-c507ef094164'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:20:24.622723 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-93b37ddc-d37e-4a0a-a704-03d9c1c94ad6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe71b9b220>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:20:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['ab86be34-7347-42c9-9bdf-c507ef094164'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:24.694022 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for floatingip, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:24.748436 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-7a2066e9-a68d-45ea-af9d-34e638963ae6 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "DELETE /v2.0/floatingips/3b4b3cb8-6693-4b49-a498-ac7276af85e9 HTTP/1.1" status: 204  len: 168 time: 1.5995650
Jun 01 10:20:24.749087 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'tag': 'a7c8635b-7446-4fde-9653-ce439be1b0e2'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:20:24.751383 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b7e2380b-37ce-4983-9dd4-b737c7b727f5" -d '{"events": [{"name": "network-changed", "server_uuid": "a86bd86c-a7bc-459a-9733-8b31623ad03c", "tag": "a7c8635b-7446-4fde-9653-ce439be1b0e2"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:20:24.803373 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-93b37ddc-d37e-4a0a-a704-03d9c1c94ad6 None None] Set router ab86be34-7347-42c9-9bdf-c507ef094164 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:20:24.897817 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 10:20:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c3b44562-d939-44bb-9605-488679949f9d x-openstack-request-id: req-c3b44562-d939-44bb-9605-488679949f9d {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:20:24.898138 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a86bd86c-a7bc-459a-9733-8b31623ad03c", "tag": "a7c8635b-7446-4fde-9653-ce439be1b0e2", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:20:24.898422 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-c3b44562-d939-44bb-9605-488679949f9d {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:20:24.898846 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'tag': 'a7c8635b-7446-4fde-9653-ce439be1b0e2', 'status': 'completed', 'code': 200}
Jun 01 10:20:25.003893 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7e2380b-37ce-4983-9dd4-b737c7b727f5 req-e1256cf0-f807-44bd-acae-f532b23f99f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:20:25.006018 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b7e2380b-37ce-4983-9dd4-b737c7b727f5 req-e1256cf0-f807-44bd-acae-f532b23f99f2 service neutron] 10.222.0.30 "GET /v2.0/ports?tenant_id=471ae02220fb428c836d64a2bb2bcb76&device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 1099 time: 0.0768614
Jun 01 10:20:25.128029 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-93b37ddc-d37e-4a0a-a704-03d9c1c94ad6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe71b9b220>, [{'id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'name': 'tempest-TestShelveInstance-1091968561-router', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201'}], 'enable_snat': True}, 'gw_port_id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:39Z', 'updated_at': '2021-06-01T10:15:44Z', 'revision_number': 4, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'gw_port': {'id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:a2:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:40Z', 'updated_at': '2021-06-01T10:15:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '8fb04901-ea66-4310-aa8b-846af9a44567', 'name': '', 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'mac_address': 'fa:16:3e:0c:31:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_interface', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:43Z', 'updated_at': '2021-06-01T10:15:50Z', 'revision_number': 5, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'subnets': [{'id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:25.132452 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93b37ddc-d37e-4a0a-a704-03d9c1c94ad6 None None] Checking router: ab86be34-7347-42c9-9bdf-c507ef094164 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:20:25.141392 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93b37ddc-d37e-4a0a-a704-03d9c1c94ad6 None None] Routers {'ab86be34-7347-42c9-9bdf-c507ef094164'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:20:25.142046 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-93b37ddc-d37e-4a0a-a704-03d9c1c94ad6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe71b9b220>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:20:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['ab86be34-7347-42c9-9bdf-c507ef094164'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:25.147846 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7e2380b-37ce-4983-9dd4-b737c7b727f5 req-95faf59b-fe09-4fa1-9283-9b4b24f02baa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:20:25.149467 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b7e2380b-37ce-4983-9dd4-b737c7b727f5 req-95faf59b-fe09-4fa1-9283-9b4b24f02baa service neutron] 10.222.0.30 "GET /v2.0/networks?id=5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 HTTP/1.1" status: 200  len: 910 time: 0.1341116
Jun 01 10:20:25.228284 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b7e2380b-37ce-4983-9dd4-b737c7b727f5 req-48dfb927-2f06-496f-ad0d-d3a0c2f6b5fe service neutron] 10.222.0.30 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a7c8635b-7446-4fde-9653-ce439be1b0e2 HTTP/1.1" status: 200  len: 217 time: 0.0647998
Jun 01 10:20:25.327011 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-93b37ddc-d37e-4a0a-a704-03d9c1c94ad6 None None] Set router ab86be34-7347-42c9-9bdf-c507ef094164 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:20:25.437288 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7e2380b-37ce-4983-9dd4-b737c7b727f5 req-f8263ca8-914c-412a-9ec2-5f11a7b3c558 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:20:25.438748 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b7e2380b-37ce-4983-9dd4-b737c7b727f5 req-f8263ca8-914c-412a-9ec2-5f11a7b3c558 service neutron] 10.222.0.30 "GET /v2.0/subnets?id=24404399-0c0c-45bf-839e-f86b0f5c30d7 HTTP/1.1" status: 200  len: 848 time: 0.1801047
Jun 01 10:20:25.509065 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a839ae99-9247-409b-8ebf-913f50fae995 req-229b8cfe-53e6-4ec6-a9df-a6d0201d5ca1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:20:25.509685 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-a839ae99-9247-409b-8ebf-913f50fae995 req-229b8cfe-53e6-4ec6-a9df-a6d0201d5ca1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Synchronizing usage tracker for tenant:471ae02220fb428c836d64a2bb2bcb76 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:20:25.546813 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7e2380b-37ce-4983-9dd4-b737c7b727f5 req-a25ef6a2-75c7-4ef3-85a9-6f322ed3fa92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:20:25.548318 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b7e2380b-37ce-4983-9dd4-b737c7b727f5 req-a25ef6a2-75c7-4ef3-85a9-6f322ed3fa92 service neutron] 10.222.0.30 "GET /v2.0/ports?network_id=5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1024287
Jun 01 10:20:25.631770 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-a839ae99-9247-409b-8ebf-913f50fae995 req-229b8cfe-53e6-4ec6-a9df-a6d0201d5ca1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Unset dirty status for tenant:471ae02220fb428c836d64a2bb2bcb76 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:20:25.632830 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a839ae99-9247-409b-8ebf-913f50fae995 req-229b8cfe-53e6-4ec6-a9df-a6d0201d5ca1 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.4063356
Jun 01 10:20:25.688985 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-93b37ddc-d37e-4a0a-a704-03d9c1c94ad6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe71b9b220>, [{'id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'name': 'tempest-TestShelveInstance-1091968561-router', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201'}], 'enable_snat': True}, 'gw_port_id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:39Z', 'updated_at': '2021-06-01T10:15:44Z', 'revision_number': 4, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'gw_port': {'id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:a2:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:40Z', 'updated_at': '2021-06-01T10:15:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '8fb04901-ea66-4310-aa8b-846af9a44567', 'name': '', 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'mac_address': 'fa:16:3e:0c:31:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_interface', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:43Z', 'updated_at': '2021-06-01T10:15:50Z', 'revision_number': 5, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'subnets': [{'id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:25.693678 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-93b37ddc-d37e-4a0a-a704-03d9c1c94ad6 None None] The sync data for ids ['ab86be34-7347-42c9-9bdf-c507ef094164'] in dv-cinder-787262-4-iscsi is: [{'id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'name': 'tempest-TestShelveInstance-1091968561-router', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201'}], 'enable_snat': True}, 'gw_port_id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:39Z', 'updated_at': '2021-06-01T10:15:44Z', 'revision_number': 4, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'gw_port': {'id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:a2:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:40Z', 'updated_at': '2021-06-01T10:15:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi', '_interfaces': [{'id': '8fb04901-ea66-4310-aa8b-846af9a44567', 'name': '', 'network_id': '5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'mac_address': 'fa:16:3e:0c:31:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_interface', 'standard_attr_id': 650, 'fixed_ips': [{'subnet_id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:43Z', 'updated_at': '2021-06-01T10:15:50Z', 'revision_number': 5, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'subnets': [{'id': '24404399-0c0c-45bf-839e-f86b0f5c30d7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:20:25.710159 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-a839ae99-9247-409b-8ebf-913f50fae995 req-a010e94a-a241-44d2-a53a-381b28872588 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0682151
Jun 01 10:20:25.718266 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b7e2380b-37ce-4983-9dd4-b737c7b727f5 req-6e1d0d45-004a-48e6-a817-dbcea983ab15 service neutron] 10.222.0.30 "GET /v2.0/networks/5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1609881
Jun 01 10:20:25.860560 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-b7e2380b-37ce-4983-9dd4-b737c7b727f5 req-c0caec19-5187-4eb2-9aa7-e9eb88770d98 service neutron] 10.222.0.30 "GET /v2.0/networks/5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1340423
Jun 01 10:20:25.929446 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1a9ec63-4250-416f-9603-0bb12828ba98 None None] New status for floating IP 3b4b3cb8-6693-4b49-a498-ac7276af85e9: DOWN {{(pid=92568) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 10:20:26.573765 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:26.952861 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76bfae7-19c4-4b34-a9fb-1f5383273d7d req-475b978a-17fe-4a25-b90b-c0194d525f61 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:20:26.959891 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e76bfae7-19c4-4b34-a9fb-1f5383273d7d req-475b978a-17fe-4a25-b90b-c0194d525f61 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.1374915
Jun 01 10:20:27.047599 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-e76bfae7-19c4-4b34-a9fb-1f5383273d7d req-6b26f385-f93d-4981-ac4d-943ce7b00b0d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/security-groups?id=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0580182
Jun 01 10:20:27.069244 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c0ca88e-4b4f-4800-8306-ff80d138c69f req-32f6ccf2-81f7-4cb1-850d-39de99dc587c tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=92566) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 10:20:27.070650 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9c0ca88e-4b4f-4800-8306-ff80d138c69f req-32f6ccf2-81f7-4cb1-850d-39de99dc587c tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.30 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 946 time: 0.1155348
Jun 01 10:20:27.209837 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-9c0ca88e-4b4f-4800-8306-ff80d138c69f req-3b61b4e5-8e54-4375-9c02-b82c4f07d23e tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Deleting port a7c8635b-7446-4fde-9653-ce439be1b0e2 {{(pid=92566) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:20:27.210091 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-9c0ca88e-4b4f-4800-8306-ff80d138c69f req-3b61b4e5-8e54-4375-9c02-b82c4f07d23e tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:27.346297 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.db [req-9c0ca88e-4b4f-4800-8306-ff80d138c69f req-3b61b4e5-8e54-4375-9c02-b82c4f07d23e tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] For port a7c8635b-7446-4fde-9653-ce439be1b0e2, host hv-cinder-78726, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78726',level=0,port_id=a7c8635b-7446-4fde-9653-ce439be1b0e2,segment=NetworkSegment(e26992f8-9861-4fb0-83e9-200e0276045e),segment_id=e26992f8-9861-4fb0-83e9-200e0276045e)] {{(pid=92566) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:20:27.346654 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-9c0ca88e-4b4f-4800-8306-ff80d138c69f req-3b61b4e5-8e54-4375-9c02-b82c4f07d23e tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:27.462800 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:20:27.472549 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.plugins.ml2.plugin [req-9c0ca88e-4b4f-4800-8306-ff80d138c69f req-3b61b4e5-8e54-4375-9c02-b82c4f07d23e tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Calling delete_port for a7c8635b-7446-4fde-9653-ce439be1b0e2 owned by compute:nova {{(pid=92566) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:20:27.659339 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-9c0ca88e-4b4f-4800-8306-ff80d138c69f req-3b61b4e5-8e54-4375-9c02-b82c4f07d23e tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2757772'] for port, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:27.665047 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-07f89f12-0d7e-4a67-b93f-cfc9193d26ef tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:20:27.710863 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b61b4e5-8e54-4375-9c02-b82c4f07d23e tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Pushing event deleted for resources: {'Port': ['ID=a7c8635b-7446-4fde-9653-ce439be1b0e2,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:20:27.713907 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-3b61b4e5-8e54-4375-9c02-b82c4f07d23e tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:20:27.787567 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.db.l3_dvrscheduler_db [req-9c0ca88e-4b4f-4800-8306-ff80d138c69f req-3b61b4e5-8e54-4375-9c02-b82c4f07d23e tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] No DVR routers for this DVR port a7c8635b-7446-4fde-9653-ce439be1b0e2 on host hv-cinder-78726 {{(pid=92566) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:20:27.789985 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [req-9c0ca88e-4b4f-4800-8306-ff80d138c69f req-3b61b4e5-8e54-4375-9c02-b82c4f07d23e tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-60207'] for port, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:27.792502 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'name': 'network-vif-deleted', 'tag': 'a7c8635b-7446-4fde-9653-ce439be1b0e2'}] {{(pid=92566) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 10:20:27.796232 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.68/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}29e10c89a0a23c6d9aea568154627070f65ddbe556a76ebe1077b81b04692acf" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fd3481c0-a781-4c71-8a12-4b4a340dadb2" -d '{"events": [{"server_uuid": "a86bd86c-a7bc-459a-9733-8b31623ad03c", "name": "network-vif-deleted", "tag": "a7c8635b-7446-4fde-9653-ce439be1b0e2"}]}' {{(pid=92566) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 10:20:27.841466 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 10:20:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-435b7fb2-96ac-49cc-8d2c-d7453e1c0008 x-openstack-request-id: req-435b7fb2-96ac-49cc-8d2c-d7453e1c0008 {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 10:20:27.841466 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a86bd86c-a7bc-459a-9733-8b31623ad03c", "name": "network-vif-deleted", "tag": "a7c8635b-7446-4fde-9653-ce439be1b0e2", "status": "completed", "code": 200}]} {{(pid=92566) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 10:20:27.841466 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.68/compute/v2.1/os-server-external-events used request id req-435b7fb2-96ac-49cc-8d2c-d7453e1c0008 {{(pid=92566) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 10:20:27.841466 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a86bd86c-a7bc-459a-9733-8b31623ad03c', 'name': 'network-vif-deleted', 'tag': 'a7c8635b-7446-4fde-9653-ce439be1b0e2', 'status': 'completed', 'code': 200}
Jun 01 10:20:27.888773 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-9c0ca88e-4b4f-4800-8306-ff80d138c69f req-3b61b4e5-8e54-4375-9c02-b82c4f07d23e tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.30 "DELETE /v2.0/ports/a7c8635b-7446-4fde-9653-ce439be1b0e2 HTTP/1.1" status: 204  len: 173 time: 0.8098233
Jun 01 10:20:28.198629 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-f813131f-9bb1-4941-9903-f40df0e6e4ac req-3cffd72d-4401-4cf1-ad41-6d992aeedf00 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Synchronizing usage tracker for tenant:471ae02220fb428c836d64a2bb2bcb76 on resource:port {{(pid=92566) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 10:20:28.287777 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.quota.resource [req-f813131f-9bb1-4941-9903-f40df0e6e4ac req-3cffd72d-4401-4cf1-ad41-6d992aeedf00 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Unset dirty status for tenant:471ae02220fb428c836d64a2bb2bcb76 on resource:port {{(pid=92566) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 10:20:28.288885 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-f813131f-9bb1-4941-9903-f40df0e6e4ac req-3cffd72d-4401-4cf1-ad41-6d992aeedf00 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 210 time: 0.1322072
Jun 01 10:20:29.450663 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [req-cb369151-6536-48e0-85c3-f958093849c7 req-48b84306-42c0-4b44-b15b-99b21f5baf1d tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "GET /v2.0/ports?device_id=a86bd86c-a7bc-459a-9733-8b31623ad03c HTTP/1.1" status: 200  len: 210 time: 0.0421550
Jun 01 10:20:30.543619 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40508) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:20:30.611787 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:30.641487 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:30.802712 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:30.806753 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7658a675-c243-45ce-9908-785165e4559f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:20:30.823679 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9c0d5e08-f5eb-42aa-9a8f-dc89327e470c,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:20:30.831692 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:30.832074 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:30.832446 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:30.832809 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:30.833171 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:30.833535 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:30.833887 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:30.834242 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:30.834597 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:30.834972 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:30.835330 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:30.835687 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92565) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:30.838824 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:20:30.892824 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:30.893957 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-641f41d3-6839-4266-9aaa-5819f1f48647 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] 10.222.0.68 "DELETE /v2.0/security-groups/9c0d5e08-f5eb-42aa-9a8f-dc89327e470c HTTP/1.1" status: 204  len: 168 time: 0.3493707
Jun 01 10:20:31.009411 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40514) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:20:31.506404 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device a7c8635b-7446-4fde-9653-ce439be1b0e2 no longer exists at agent hyperv_hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:20:31.539395 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f6f2c8bd-3f6a-4c6b-a2db-32c7a2b68ad6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-401846'] for router_interface, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:31.540411 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] No Port match for: a7c8635b-7446-4fde-9653-ce439be1b0e2 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:20:31.540759 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Device a7c8635b-7446-4fde-9653-ce439be1b0e2 not bound to the agent host hv-cinder-78726 {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:20:31.943742 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-f6f2c8bd-3f6a-4c6b-a2db-32c7a2b68ad6 admin admin] Deleting port 8fb04901-ea66-4310-aa8b-846af9a44567 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:20:31.944360 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f6f2c8bd-3f6a-4c6b-a2db-32c7a2b68ad6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:32.159756 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-f6f2c8bd-3f6a-4c6b-a2db-32c7a2b68ad6 admin admin] For port 8fb04901-ea66-4310-aa8b-846af9a44567, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=8fb04901-ea66-4310-aa8b-846af9a44567,segment=NetworkSegment(e26992f8-9861-4fb0-83e9-200e0276045e),segment_id=e26992f8-9861-4fb0-83e9-200e0276045e)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:20:32.160002 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f6f2c8bd-3f6a-4c6b-a2db-32c7a2b68ad6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:32.279706 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-f6f2c8bd-3f6a-4c6b-a2db-32c7a2b68ad6 admin admin] Calling delete_port for 8fb04901-ea66-4310-aa8b-846af9a44567 owned by network:router_interface {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:20:32.482221 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f6f2c8bd-3f6a-4c6b-a2db-32c7a2b68ad6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:32.487375 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-850b2303-ba88-4814-a9aa-b67d54c002e2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:20:32.532849 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6f2c8bd-3f6a-4c6b-a2db-32c7a2b68ad6 admin admin] Pushing event deleted for resources: {'Port': ['ID=8fb04901-ea66-4310-aa8b-846af9a44567,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:20:32.566422 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f6f2c8bd-3f6a-4c6b-a2db-32c7a2b68ad6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:20:32.806496 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f6f2c8bd-3f6a-4c6b-a2db-32c7a2b68ad6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7875317', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-405030'] for router_interface, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:33.167862 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f6f2c8bd-3f6a-4c6b-a2db-32c7a2b68ad6 admin admin] Router ab86be34-7347-42c9-9bdf-c507ef094164 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:20:33.340872 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f6f2c8bd-3f6a-4c6b-a2db-32c7a2b68ad6 admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:20:33.350210 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b940651-6707-4979-91ca-0069c0b78418 None None] Sync routers for ids ['ab86be34-7347-42c9-9bdf-c507ef094164'] in dv-cinder-787262-4-iscsi {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:20:33.359096 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b940651-6707-4979-91ca-0069c0b78418 None None] Routers {'ab86be34-7347-42c9-9bdf-c507ef094164'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:20:33.359708 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-5b940651-6707-4979-91ca-0069c0b78418 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe71a3ec40>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:20:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['ab86be34-7347-42c9-9bdf-c507ef094164'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:33.421035 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-f6f2c8bd-3f6a-4c6b-a2db-32c7a2b68ad6 admin admin] 10.222.0.68 "PUT /v2.0/routers/ab86be34-7347-42c9-9bdf-c507ef094164/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4104943
Jun 01 10:20:33.423521 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40518) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:20:33.538741 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-5b940651-6707-4979-91ca-0069c0b78418 None None] Set router ab86be34-7347-42c9-9bdf-c507ef094164 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:20:33.709611 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c55d1fbb-e858-4188-b59f-2c2f0c011d14 admin admin] Notify callbacks [] for router, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:33.830104 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-5b940651-6707-4979-91ca-0069c0b78418 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe71a3ec40>, [{'id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'name': 'tempest-TestShelveInstance-1091968561-router', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201'}], 'enable_snat': True}, 'gw_port_id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:39Z', 'updated_at': '2021-06-01T10:20:32Z', 'revision_number': 5, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'gw_port': {'id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:a2:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:40Z', 'updated_at': '2021-06-01T10:15:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:33.834018 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b940651-6707-4979-91ca-0069c0b78418 None None] Checking router: ab86be34-7347-42c9-9bdf-c507ef094164 for host: dv-cinder-787262-4-iscsi {{(pid=92567) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:20:33.842929 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b940651-6707-4979-91ca-0069c0b78418 None None] Routers {'ab86be34-7347-42c9-9bdf-c507ef094164'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92567) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:20:33.843483 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-5b940651-6707-4979-91ca-0069c0b78418 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe71a3ec40>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:20:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['ab86be34-7347-42c9-9bdf-c507ef094164'], 'active': True} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:33.891547 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c55d1fbb-e858-4188-b59f-2c2f0c011d14 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:34.028743 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-c55d1fbb-e858-4188-b59f-2c2f0c011d14 admin admin] Deleting port 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:20:34.029022 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvr_db [None req-5b940651-6707-4979-91ca-0069c0b78418 None None] Set router ab86be34-7347-42c9-9bdf-c507ef094164 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92567) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:20:34.029259 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c55d1fbb-e858-4188-b59f-2c2f0c011d14 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:34.152111 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-c55d1fbb-e858-4188-b59f-2c2f0c011d14 admin admin] For port 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:20:34.152474 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c55d1fbb-e858-4188-b59f-2c2f0c011d14 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:34.277958 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-c55d1fbb-e858-4188-b59f-2c2f0c011d14 admin admin] Calling delete_port for 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3 owned by network:router_gateway {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:20:34.317745 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_hamode_db [None req-5b940651-6707-4979-91ca-0069c0b78418 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe71a3ec40>, [{'id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'name': 'tempest-TestShelveInstance-1091968561-router', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201'}], 'enable_snat': True}, 'gw_port_id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:39Z', 'updated_at': '2021-06-01T10:20:32Z', 'revision_number': 5, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'gw_port': {'id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:a2:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:40Z', 'updated_at': '2021-06-01T10:15:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92567) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:34.321503 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b940651-6707-4979-91ca-0069c0b78418 None None] The sync data for ids ['ab86be34-7347-42c9-9bdf-c507ef094164'] in dv-cinder-787262-4-iscsi is: [{'id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'name': 'tempest-TestShelveInstance-1091968561-router', 'tenant_id': '471ae02220fb428c836d64a2bb2bcb76', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201'}], 'enable_snat': True}, 'gw_port_id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:39Z', 'updated_at': '2021-06-01T10:20:32Z', 'revision_number': 5, 'project_id': '471ae02220fb428c836d64a2bb2bcb76', 'gw_port': {'id': '0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:81:a2:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ab86be34-7347-42c9-9bdf-c507ef094164', 'device_owner': 'network:router_gateway', 'standard_attr_id': 644, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:40Z', 'updated_at': '2021-06-01T10:15:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}] {{(pid=92567) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:20:34.487733 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c55d1fbb-e858-4188-b59f-2c2f0c011d14 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:34.492487 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-806ffc02-ef43-41ed-a244-23e6f346eb97 tempest-TestMinimumBasicScenario-1127405949 tempest-TestMinimumBasicScenario-1127405949-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:20:34.535294 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c55d1fbb-e858-4188-b59f-2c2f0c011d14 admin admin] Pushing event deleted for resources: {'Port': ['ID=0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:20:34.565205 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-c55d1fbb-e858-4188-b59f-2c2f0c011d14 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:20:34.630536 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c55d1fbb-e858-4188-b59f-2c2f0c011d14 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-403627'] for router_gateway, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:34.805100 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c55d1fbb-e858-4188-b59f-2c2f0c011d14 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-405542', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-15816'] for router, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:34.807485 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c55d1fbb-e858-4188-b59f-2c2f0c011d14 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:34.916213 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c55d1fbb-e858-4188-b59f-2c2f0c011d14 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-406042'] for router, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:34.916694 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c55d1fbb-e858-4188-b59f-2c2f0c011d14 admin admin] Fanout notify agent at l3_agent the message router_deleted on router ab86be34-7347-42c9-9bdf-c507ef094164 {{(pid=92565) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 10:20:34.929755 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-c55d1fbb-e858-4188-b59f-2c2f0c011d14 admin admin] Notify callbacks [] for router, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:34.930880 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-c55d1fbb-e858-4188-b59f-2c2f0c011d14 admin admin] 10.222.0.68 "DELETE /v2.0/routers/ab86be34-7347-42c9-9bdf-c507ef094164 HTTP/1.1" status: 204  len: 168 time: 1.5064285
Jun 01 10:20:34.933447 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40522) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:20:34.995566 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_v2 [None req-f0bf76a2-4ebb-474f-8bfa-afc6e10dc0df admin admin] Deleting subnet 24404399-0c0c-45bf-839e-f86b0f5c30d7 {{(pid=92565) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 10:20:34.998664 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f0bf76a2-4ebb-474f-8bfa-afc6e10dc0df admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:35.052158 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f0bf76a2-4ebb-474f-8bfa-afc6e10dc0df admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2998467'] for subnet, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:35.127620 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f0bf76a2-4ebb-474f-8bfa-afc6e10dc0df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7791835'] for subnet, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:35.596801 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f0bf76a2-4ebb-474f-8bfa-afc6e10dc0df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7793006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2233195', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3139387'] for subnet, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:35.601134 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:20:35.635916 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0bf76a2-4ebb-474f-8bfa-afc6e10dc0df admin admin] Pushing event deleted for resources: {'Subnet': ['ID=24404399-0c0c-45bf-839e-f86b0f5c30d7,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:20:35.639214 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-f0bf76a2-4ebb-474f-8bfa-afc6e10dc0df admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:20:35.640199 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-f0bf76a2-4ebb-474f-8bfa-afc6e10dc0df admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:35.645634 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ad412d6-ec89-411a-ac8a-27cd44b16ede None None] Network 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:20:35.647672 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-f0bf76a2-4ebb-474f-8bfa-afc6e10dc0df admin admin] 10.222.0.68 "DELETE /v2.0/subnets/24404399-0c0c-45bf-839e-f86b0f5c30d7 HTTP/1.1" status: 204  len: 168 time: 0.7125759
Jun 01 10:20:35.649517 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40526) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:20:35.759037 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7813807'] for network, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:35.829425 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] Deleting port 80c66ba5-ac11-424a-a1e7-d07b1e821234 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:20:35.829767 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:35.895096 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:20:35.933715 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] For port 80c66ba5-ac11-424a-a1e7-d07b1e821234, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=80c66ba5-ac11-424a-a1e7-d07b1e821234,segment=NetworkSegment(e26992f8-9861-4fb0-83e9-200e0276045e),segment_id=e26992f8-9861-4fb0-83e9-200e0276045e)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:20:35.934075 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:35.938333 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:20:35.938680 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 0ec0a2ef-8e3a-4a05-a5ef-f221a1b5eef3 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:20:35.939136 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 8fb04901-ea66-4310-aa8b-846af9a44567 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:20:35.971654 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] DHCP port deletion for 5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 request from dv-cinder-787262-4-iscsi {{(pid=92567) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 10:20:35.980167 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: 8fb04901-ea66-4310-aa8b-846af9a44567 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:20:35.980508 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 8fb04901-ea66-4310-aa8b-846af9a44567 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:20:36.044196 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Deleting port 80c66ba5-ac11-424a-a1e7-d07b1e821234 {{(pid=92567) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:20:36.044559 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:36.062490 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] Calling delete_port for 80c66ba5-ac11-424a-a1e7-d07b1e821234 owned by network:dhcp {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:20:36.138289 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] For port 80c66ba5-ac11-424a-a1e7-d07b1e821234, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=80c66ba5-ac11-424a-a1e7-d07b1e821234,segment=NetworkSegment(e26992f8-9861-4fb0-83e9-200e0276045e),segment_id=e26992f8-9861-4fb0-83e9-200e0276045e)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:20:36.138595 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:36.156360 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:36.160242 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-eb08112b-7614-4241-b855-e0713ed112ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:20:36.203755 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] Pushing event deleted for resources: {'Port': ['ID=80c66ba5-ac11-424a-a1e7-d07b1e821234,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:20:36.207674 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:20:36.209416 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] No DVR routers for this DVR port 80c66ba5-ac11-424a-a1e7-d07b1e821234 on host dv-cinder-787262-4-iscsi {{(pid=92565) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:20:36.261661 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Calling delete_port for 80c66ba5-ac11-424a-a1e7-d07b1e821234 owned by network:dhcp {{(pid=92567) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:20:36.303541 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820'] for port, after_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:36.308114 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:20:36.324744 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7795028', 'neutron.services.segments.db._delete_segments_for_network-8726958294492'] for network, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:36.338523 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7efe7130c340>,) {'filters': {'network_id': ['5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9']}} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:36.350791 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7efe7130c340>, 'e26992f8-9861-4fb0-83e9-200e0276045e') {'for_net_delete': True} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:36.351122 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7efe7130c340>, 'e26992f8-9861-4fb0-83e9-200e0276045e') {} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:36.351277 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Pushing event deleted for resources: {'Port': ['ID=80c66ba5-ac11-424a-a1e7-d07b1e821234,revision_number=None']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:20:36.355546 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] No DVR routers for this DVR port 80c66ba5-ac11-424a-a1e7-d07b1e821234 on host dv-cinder-787262-4-iscsi {{(pid=92567) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:20:36.366537 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726958303133', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2998472'] for segment, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:36.368291 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:36.369956 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:36.369956 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:36.369956 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:36.369956 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:36.369956 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:36.370545 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:36.370545 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:36.370836 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:36.371175 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:36.371515 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:36.371828 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-787262-4-iscsi {{(pid=92567) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 10:20:36.374931 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-a1ab4dad-36b1-43fc-8636-6aee587393cf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:20:36.384190 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:36.390456 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] Releasing vlan 895 on physical network physnet1 to pool {{(pid=92565) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 10:20:36.390811 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2295757'] for segment, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]: Traceback (most recent call last):
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:     timer()
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:     cb(*args, **kw)
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:     return func(*args, **kwargs)
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:     self._notify()
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:     self.callback(batched_events)
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:     event.method(event)
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:     return f(self, *a, **k)
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._get(url).json()
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self.request(url, 'GET', **kwargs)
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 10:20:36.404298 dv-cinder-787262-4-iscsi neutron-server[92565]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 10:20:36.550505 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7795037', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-403638'] for network, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:36.554440 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-30db22bb-bc9a-45c3-b09f-d3e28ac01645 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:20:36.568547 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:36.578478 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] Pushing event deleted for resources: {'Network': ['ID=5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:20:36.582543 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:20:36.586533 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-cab31879-f991-44ed-9798-edc3388f4e8d admin admin] 10.222.0.68 "DELETE /v2.0/networks/5b540ecd-3e1d-4e74-b7ac-a8a8e50d07d9 HTTP/1.1" status: 204  len: 168 time: 0.9361041
Jun 01 10:20:36.589447 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40530) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:20:37.219704 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7645a7db-a0dc-448e-b12a-009fe5c66c8d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-401846'] for router_interface, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:37.627894 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-7645a7db-a0dc-448e-b12a-009fe5c66c8d admin admin] Deleting port ada4efcd-4160-49fa-b890-c5d5cd520e7d {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:20:37.628584 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7645a7db-a0dc-448e-b12a-009fe5c66c8d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:37.751915 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-7645a7db-a0dc-448e-b12a-009fe5c66c8d admin admin] For port ada4efcd-4160-49fa-b890-c5d5cd520e7d, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=ada4efcd-4160-49fa-b890-c5d5cd520e7d,segment=NetworkSegment(9e12f326-6344-4c0a-b629-df279527972c),segment_id=9e12f326-6344-4c0a-b629-df279527972c)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:20:37.752281 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7645a7db-a0dc-448e-b12a-009fe5c66c8d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:37.876167 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-7645a7db-a0dc-448e-b12a-009fe5c66c8d admin admin] Calling delete_port for ada4efcd-4160-49fa-b890-c5d5cd520e7d owned by network:router_interface {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:20:37.887459 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 80c66ba5-ac11-424a-a1e7-d07b1e821234 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:20:37.925183 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: 80c66ba5-ac11-424a-a1e7-d07b1e821234 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:20:37.925532 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 80c66ba5-ac11-424a-a1e7-d07b1e821234 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:20:38.098911 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7645a7db-a0dc-448e-b12a-009fe5c66c8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:38.102547 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a8596cde-fb2c-4e8d-8e62-a63277b7065c tempest-TestVolumeBootPattern-1749397097 tempest-TestVolumeBootPattern-1749397097-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:20:38.149341 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7645a7db-a0dc-448e-b12a-009fe5c66c8d admin admin] Pushing event deleted for resources: {'Port': ['ID=ada4efcd-4160-49fa-b890-c5d5cd520e7d,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:20:38.153448 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7645a7db-a0dc-448e-b12a-009fe5c66c8d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:20:38.418454 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-7645a7db-a0dc-448e-b12a-009fe5c66c8d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-7875317', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-405030'] for router_interface, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:38.874670 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7645a7db-a0dc-448e-b12a-009fe5c66c8d admin admin] Router 39eceb04-a094-494b-91e3-8011703901a1 has already been hosted by L3 agent 323b727f-1f02-4f59-8976-0e27bec46a0c {{(pid=92565) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 10:20:39.053659 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7645a7db-a0dc-448e-b12a-009fe5c66c8d admin admin] Notify agent at l3_agent.dv-cinder-787262-4-iscsi the message routers_updated {{(pid=92565) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 10:20:39.062028 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-535fc34f-2fe0-455d-b792-b1098aab73c7 None None] Sync routers for ids ['39eceb04-a094-494b-91e3-8011703901a1'] in dv-cinder-787262-4-iscsi {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 10:20:39.071949 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-535fc34f-2fe0-455d-b792-b1098aab73c7 None None] Routers {'39eceb04-a094-494b-91e3-8011703901a1'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:20:39.078383 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-535fc34f-2fe0-455d-b792-b1098aab73c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7278a8b0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:20:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['39eceb04-a094-494b-91e3-8011703901a1'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:39.128100 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-7645a7db-a0dc-448e-b12a-009fe5c66c8d admin admin] 10.222.0.68 "PUT /v2.0/routers/39eceb04-a094-494b-91e3-8011703901a1/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5376127
Jun 01 10:20:39.130607 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40534) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:20:39.244862 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-535fc34f-2fe0-455d-b792-b1098aab73c7 None None] Set router 39eceb04-a094-494b-91e3-8011703901a1 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:20:39.480765 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-805e0ac5-854d-4fde-9d82-1d3c6ca37209 admin admin] Notify callbacks [] for router, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:39.523944 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-535fc34f-2fe0-455d-b792-b1098aab73c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7278a8b0>, [{'id': '39eceb04-a094-494b-91e3-8011703901a1', 'name': 'tempest-TestShelveInstance-1143761624-router', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118'}], 'enable_snat': True}, 'gw_port_id': '375f5060-c027-4752-a148-f3765076bed3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:48Z', 'updated_at': '2021-06-01T10:20:37Z', 'revision_number': 5, 'project_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'gw_port': {'id': '375f5060-c027-4752-a148-f3765076bed3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:be:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39eceb04-a094-494b-91e3-8011703901a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:49Z', 'updated_at': '2021-06-01T10:15:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:39.527762 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-535fc34f-2fe0-455d-b792-b1098aab73c7 None None] Checking router: 39eceb04-a094-494b-91e3-8011703901a1 for host: dv-cinder-787262-4-iscsi {{(pid=92568) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 10:20:39.536051 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvrscheduler_db [None req-535fc34f-2fe0-455d-b792-b1098aab73c7 None None] Routers {'39eceb04-a094-494b-91e3-8011703901a1'} bound to L3 agent in host dv-cinder-787262-4-iscsi {{(pid=92568) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 10:20:39.536642 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-535fc34f-2fe0-455d-b792-b1098aab73c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7efe7278a8b0>, 'dv-cinder-787262-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T09:58:13Z,description=<?>,heartbeat_timestamp=2021-06-01T10:20:13Z,host='dv-cinder-787262-4-iscsi',id=323b727f-1f02-4f59-8976-0e27bec46a0c,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T09:58:14Z,topic='l3_agent')) {'router_ids': ['39eceb04-a094-494b-91e3-8011703901a1'], 'active': True} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:39.657859 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-805e0ac5-854d-4fde-9d82-1d3c6ca37209 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:39.710118 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_dvr_db [None req-535fc34f-2fe0-455d-b792-b1098aab73c7 None None] Set router 39eceb04-a094-494b-91e3-8011703901a1 gateway port host: dv-cinder-787262-4-iscsi {{(pid=92568) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 10:20:39.803220 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-805e0ac5-854d-4fde-9d82-1d3c6ca37209 admin admin] Deleting port 375f5060-c027-4752-a148-f3765076bed3 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:20:39.803568 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-805e0ac5-854d-4fde-9d82-1d3c6ca37209 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:39.928708 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-805e0ac5-854d-4fde-9d82-1d3c6ca37209 admin admin] For port 375f5060-c027-4752-a148-f3765076bed3, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=375f5060-c027-4752-a148-f3765076bed3,segment=NetworkSegment(4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8),segment_id=4ba1fb1c-ffd1-4ac8-a4b9-e1828c5c85a8)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:20:39.928987 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-805e0ac5-854d-4fde-9d82-1d3c6ca37209 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:40.026770 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.l3_hamode_db [None req-535fc34f-2fe0-455d-b792-b1098aab73c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7efe7278a8b0>, [{'id': '39eceb04-a094-494b-91e3-8011703901a1', 'name': 'tempest-TestShelveInstance-1143761624-router', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118'}], 'enable_snat': True}, 'gw_port_id': '375f5060-c027-4752-a148-f3765076bed3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:48Z', 'updated_at': '2021-06-01T10:20:37Z', 'revision_number': 5, 'project_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'gw_port': {'id': '375f5060-c027-4752-a148-f3765076bed3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:be:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39eceb04-a094-494b-91e3-8011703901a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:49Z', 'updated_at': '2021-06-01T10:15:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}], 'dv-cinder-787262-4-iscsi', False) {} {{(pid=92568) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:40.030602 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-535fc34f-2fe0-455d-b792-b1098aab73c7 None None] The sync data for ids ['39eceb04-a094-494b-91e3-8011703901a1'] in dv-cinder-787262-4-iscsi is: [{'id': '39eceb04-a094-494b-91e3-8011703901a1', 'name': 'tempest-TestShelveInstance-1143761624-router', 'tenant_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'external_fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118'}], 'enable_snat': True}, 'gw_port_id': '375f5060-c027-4752-a148-f3765076bed3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T10:15:48Z', 'updated_at': '2021-06-01T10:20:37Z', 'revision_number': 5, 'project_id': '2a47e8f3f9e145ef9f900fd364b8d69e', 'gw_port': {'id': '375f5060-c027-4752-a148-f3765076bed3', 'name': '', 'network_id': 'a961b732-0873-4e86-af5a-7e84ae1a2549', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:be:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39eceb04-a094-494b-91e3-8011703901a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'ip_address': '172.27.2.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-787262-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T10:15:49Z', 'updated_at': '2021-06-01T10:15:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '0acb7e18-8599-43e3-af85-b85c21da308c', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-787262-4-iscsi'}] {{(pid=92568) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 10:20:40.062166 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-805e0ac5-854d-4fde-9d82-1d3c6ca37209 admin admin] Calling delete_port for 375f5060-c027-4752-a148-f3765076bed3 owned by network:router_gateway {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:20:40.230503 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-805e0ac5-854d-4fde-9d82-1d3c6ca37209 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:40.235010 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-edb9a26a-bdfe-4054-ab74-4fb60a106b38 tempest-TestShelveInstance-1348419531 tempest-TestShelveInstance-1348419531-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:20:40.281254 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-805e0ac5-854d-4fde-9d82-1d3c6ca37209 admin admin] Pushing event deleted for resources: {'Port': ['ID=375f5060-c027-4752-a148-f3765076bed3,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:20:40.308367 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-805e0ac5-854d-4fde-9d82-1d3c6ca37209 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:20:40.371596 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-805e0ac5-854d-4fde-9d82-1d3c6ca37209 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-403627'] for router_gateway, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:40.476741 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-5c419e70-420c-4486-b2a1-a9b6146b8363 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:40.650576 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-805e0ac5-854d-4fde-9d82-1d3c6ca37209 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-405542', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-15816'] for router, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:40.652753 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-805e0ac5-854d-4fde-9d82-1d3c6ca37209 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:40.760865 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-805e0ac5-854d-4fde-9d82-1d3c6ca37209 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-406042'] for router, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:40.761430 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-805e0ac5-854d-4fde-9d82-1d3c6ca37209 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 39eceb04-a094-494b-91e3-8011703901a1 {{(pid=92565) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 10:20:40.774469 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-805e0ac5-854d-4fde-9d82-1d3c6ca37209 admin admin] Notify callbacks [] for router, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:40.775656 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-805e0ac5-854d-4fde-9d82-1d3c6ca37209 admin admin] 10.222.0.68 "DELETE /v2.0/routers/39eceb04-a094-494b-91e3-8011703901a1 HTTP/1.1" status: 204  len: 168 time: 1.6441183
Jun 01 10:20:40.778227 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40540) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:20:40.839140 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.db_base_plugin_v2 [None req-22e68e2a-ff8c-4787-9ac5-6db602e5a244 admin admin] Deleting subnet a4b585d7-ef27-470b-b96e-0aa45e5010f2 {{(pid=92565) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 10:20:40.842414 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-22e68e2a-ff8c-4787-9ac5-6db602e5a244 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:40.895584 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-22e68e2a-ff8c-4787-9ac5-6db602e5a244 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2998467'] for subnet, precommit_delete_associations {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:40.977555 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-22e68e2a-ff8c-4787-9ac5-6db602e5a244 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7791835'] for subnet, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:41.276531 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-22e68e2a-ff8c-4787-9ac5-6db602e5a244 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7793006', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41573', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2233195', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3139387'] for subnet, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:41.280492 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8a5493a4-68df-46c3-9669-d955365d335b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:20:41.320655 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22e68e2a-ff8c-4787-9ac5-6db602e5a244 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a4b585d7-ef27-470b-b96e-0aa45e5010f2,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:20:41.323726 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-22e68e2a-ff8c-4787-9ac5-6db602e5a244 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:20:41.324707 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-22e68e2a-ff8c-4787-9ac5-6db602e5a244 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for subnet, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:41.330795 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-22e68e2a-ff8c-4787-9ac5-6db602e5a244 admin admin] 10.222.0.68 "DELETE /v2.0/subnets/a4b585d7-ef27-470b-b96e-0aa45e5010f2 HTTP/1.1" status: 204  len: 168 time: 0.5516095
Jun 01 10:20:41.331179 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be2f6cbd-64f9-40bb-8064-321b639cba55 None None] Network b84d4572-17d4-48c6-8bc7-d9db903ef2e8 requested from dv-cinder-787262-4-iscsi {{(pid=92567) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 10:20:41.333534 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40544) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:20:41.439746 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7813807'] for network, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:41.510979 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] Deleting port b7308964-c86d-4edc-8c4b-ad84665b6746 {{(pid=92565) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:20:41.511260 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:41.575119 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2a8719f4-d058-415d-a660-6a83f64f843d None None] DHCP port deletion for b84d4572-17d4-48c6-8bc7-d9db903ef2e8 request from dv-cinder-787262-4-iscsi {{(pid=92567) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 10:20:41.612022 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.db [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] For port b7308964-c86d-4edc-8c4b-ad84665b6746, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=b7308964-c86d-4edc-8c4b-ad84665b6746,segment=NetworkSegment(9e12f326-6344-4c0a-b629-df279527972c),segment_id=9e12f326-6344-4c0a-b629-df279527972c)] {{(pid=92565) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:20:41.612384 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:41.644513 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-2a8719f4-d058-415d-a660-6a83f64f843d None None] Deleting port b7308964-c86d-4edc-8c4b-ad84665b6746 {{(pid=92567) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 10:20:41.644891 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-2a8719f4-d058-415d-a660-6a83f64f843d None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726958281283'] for port, before_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:41.735865 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.plugin [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] Calling delete_port for b7308964-c86d-4edc-8c4b-ad84665b6746 owned by network:dhcp {{(pid=92565) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:20:41.741105 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.db [None req-2a8719f4-d058-415d-a660-6a83f64f843d None None] For port b7308964-c86d-4edc-8c4b-ad84665b6746, host dv-cinder-787262-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-787262-4-iscsi',level=0,port_id=b7308964-c86d-4edc-8c4b-ad84665b6746,segment=NetworkSegment(9e12f326-6344-4c0a-b629-df279527972c),segment_id=9e12f326-6344-4c0a-b629-df279527972c)] {{(pid=92567) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 10:20:41.741502 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-2a8719f4-d058-415d-a660-6a83f64f843d None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-403303'] for port, precommit_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:41.867513 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-2a8719f4-d058-415d-a660-6a83f64f843d None None] Calling delete_port for b7308964-c86d-4edc-8c4b-ad84665b6746 owned by network:dhcp {{(pid=92567) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 10:20:41.892906 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device ada4efcd-4160-49fa-b890-c5d5cd520e7d no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:20:41.904619 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2295704'] for port, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:41.908604 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-9c0f8fff-6385-4e97-9283-3596535e91a5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:20:41.929537 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: ada4efcd-4160-49fa-b890-c5d5cd520e7d {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:20:41.929908 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device ada4efcd-4160-49fa-b890-c5d5cd520e7d not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:20:41.930333 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device b7308964-c86d-4edc-8c4b-ad84665b6746 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:20:41.956286 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] Pushing event deleted for resources: {'Port': ['ID=b7308964-c86d-4edc-8c4b-ad84665b6746,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:20:41.960941 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:20:41.961623 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] No DVR routers for this DVR port b7308964-c86d-4edc-8c4b-ad84665b6746 on host dv-cinder-787262-4-iscsi {{(pid=92565) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:20:41.967463 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: b7308964-c86d-4edc-8c4b-ad84665b6746 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:20:41.967817 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device b7308964-c86d-4edc-8c4b-ad84665b6746 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:20:41.968348 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 375f5060-c027-4752-a148-f3765076bed3 no longer exists at agent ovs-agent-dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 10:20:42.007728 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.plugin [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] No Port match for: 375f5060-c027-4752-a148-f3765076bed3 {{(pid=92567) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 10:20:42.008513 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.plugins.ml2.rpc [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Device 375f5060-c027-4752-a148-f3765076bed3 not bound to the agent host dv-cinder-787262-4-iscsi {{(pid=92567) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 10:20:42.022116 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-2a8719f4-d058-415d-a660-6a83f64f843d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-7847872', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-41562', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-7875303', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726958284454', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726957849820'] for port, after_delete {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:42.025731 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:20:42.067837 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a8719f4-d058-415d-a660-6a83f64f843d None None] Pushing event deleted for resources: {'Port': ['ID=b7308964-c86d-4edc-8c4b-ad84665b6746,revision_number=None']} {{(pid=92567) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:20:42.070662 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG oslo_concurrency.lockutils [None req-2a8719f4-d058-415d-a660-6a83f64f843d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=92567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:20:42.072959 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a8719f4-d058-415d-a660-6a83f64f843d None None] No DVR routers for this DVR port b7308964-c86d-4edc-8c4b-ad84665b6746 on host dv-cinder-787262-4-iscsi {{(pid=92567) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 10:20:42.081671 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7795028', 'neutron.services.segments.db._delete_segments_for_network-8726958294492'] for network, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:42.094733 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7efe70c57ac0>,) {'filters': {'network_id': ['b84d4572-17d4-48c6-8bc7-d9db903ef2e8']}} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:42.106755 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7efe70c57ac0>, '9e12f326-6344-4c0a-b629-df279527972c') {'for_net_delete': True} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:42.107086 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.services.segments.db [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7efe70c57ac0>, '9e12f326-6344-4c0a-b629-df279527972c') {} {{(pid=92565) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 10:20:42.118989 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726958303133', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2998472'] for segment, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:42.135068 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548'] for segment, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:42.140947 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] Releasing vlan 872 on physical network physnet1 to pool {{(pid=92565) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 10:20:42.145312 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7789548', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2295757'] for segment, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]: Traceback (most recent call last):
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:     timer()
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:     cb(*args, **kw)
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:     return func(*args, **kwargs)
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:     self._notify()
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:     self.callback(batched_events)
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:     event.method(event)
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:     return f(self, *a, **k)
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._get(url).json()
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:     return self.request(url, 'GET', **kwargs)
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 10:20:42.154668 dv-cinder-787262-4-iscsi neutron-server[92565]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 10:20:42.414076 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7795037', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-522807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-7875324', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-403638'] for network, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:42.417527 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-a89db44e-88c2-4be3-8923-911d34851ca5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:20:42.431235 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-7875289'] for network, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:42.443325 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] Pushing event deleted for resources: {'Network': ['ID=b84d4572-17d4-48c6-8bc7-d9db903ef2e8,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:20:42.446794 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:20:42.448584 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-8f586651-b0ae-4e76-b44c-c368be152aa1 admin admin] 10.222.0.68 "DELETE /v2.0/networks/b84d4572-17d4-48c6-8bc7-d9db903ef2e8 HTTP/1.1" status: 204  len: 168 time: 1.1136386
Jun 01 10:20:42.767649 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40550) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:20:42.816561 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-4c77ce86-4411-43b8-ac4c-b72714cb01c5 admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=471ae02220fb428c836d64a2bb2bcb76&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0475917
Jun 01 10:20:42.819559 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [-] (92565) accepted ('10.222.0.68', 40554) {{(pid=92565) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:20:42.876705 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cf795068-01a5-4d63-bd8a-be65f5a10b5d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:42.903044 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cf795068-01a5-4d63-bd8a-be65f5a10b5d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:42.967284 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7aec3634-a824-4971-bd44-fd8c6e7f8a6e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:43.058828 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cf795068-01a5-4d63-bd8a-be65f5a10b5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:43.062740 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-7815adec-0ffb-4901-ac7f-98905a63ba17 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:20:43.075638 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf795068-01a5-4d63-bd8a-be65f5a10b5d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cf8ffd21-03cc-4285-a534-4474feea7a45,revision_number=None']} {{(pid=92565) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:20:43.078108 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG oslo_concurrency.lockutils [None req-cf795068-01a5-4d63-bd8a-be65f5a10b5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=92565) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:20:43.086360 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron_lib.callbacks.manager [None req-cf795068-01a5-4d63-bd8a-be65f5a10b5d admin admin] Notify callbacks [] for security_group, before_response {{(pid=92565) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:43.087680 dv-cinder-787262-4-iscsi neutron-server[92565]: INFO neutron.wsgi [None req-cf795068-01a5-4d63-bd8a-be65f5a10b5d admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/cf8ffd21-03cc-4285-a534-4474feea7a45 HTTP/1.1" status: 204  len: 168 time: 0.2672069
Jun 01 10:20:43.270635 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:43.776691 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 40562) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:20:43.829301 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-c00edaf1-5f53-44d7-b692-4df44abe64bd admin admin] 10.222.0.68 "GET /v2.0/security-groups?tenant_id=2a47e8f3f9e145ef9f900fd364b8d69e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0513444
Jun 01 10:20:43.831626 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [-] (92566) accepted ('10.222.0.68', 40566) {{(pid=92566) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 10:20:43.891707 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fa03d51a-52de-403b-8a34-3cb19af878eb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:43.917683 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fa03d51a-52de-403b-8a34-3cb19af878eb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:44.044642 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fa03d51a-52de-403b-8a34-3cb19af878eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-522871'] for security_group, after_delete {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:44.049760 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-6db635e2-2ffb-4ac6-9ae5-0113443bfca1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 10:20:44.064852 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa03d51a-52de-403b-8a34-3cb19af878eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0340219f-5e46-4325-8e32-73f73bf00d8b,revision_number=None']} {{(pid=92566) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 10:20:44.067461 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG oslo_concurrency.lockutils [None req-fa03d51a-52de-403b-8a34-3cb19af878eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=92566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 10:20:44.069627 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron_lib.callbacks.manager [None req-fa03d51a-52de-403b-8a34-3cb19af878eb admin admin] Notify callbacks [] for security_group, before_response {{(pid=92566) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:44.070742 dv-cinder-787262-4-iscsi neutron-server[92566]: INFO neutron.wsgi [None req-fa03d51a-52de-403b-8a34-3cb19af878eb admin admin] 10.222.0.68 "DELETE /v2.0/security-groups/0340219f-5e46-4325-8e32-73f73bf00d8b HTTP/1.1" status: 204  len: 168 time: 0.2382247
Jun 01 10:20:44.082892 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:45.824991 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:20:56.578772 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:21:04.460824 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:21:10.504655 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-50c2393b-3230-4cdf-a47d-b1cbbb088e41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:21:12.984636 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-43861cf5-f379-45a9-9268-dca331a30d78 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:21:13.258709 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:21:14.070465 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:21:15.824630 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:21:26.595830 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:21:40.475535 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-54aa04ef-bc03-4149-b3f2-af5d18446b17 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:21:41.459000 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:21:42.966912 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-f0d8f089-ed99-4500-85bb-bd9f1b128a42 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:21:43.257747 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:21:43.791001 dv-cinder-787262-4-iscsi neutron-server[92566]: DEBUG neutron.wsgi [req-63864984-9966-4ebe-912e-1a45bd910dfd req-a85c2d57-4786-4825-82b6-5dcf42d903a9 service neutron] (92566) timed out ('10.222.0.30', 60242) {{(pid=92566) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
Jun 01 10:21:44.074678 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:21:44.800112 dv-cinder-787262-4-iscsi neutron-server[92565]: DEBUG neutron.wsgi [req-39b5f36e-44f4-4a00-881b-289dde4c67ab req-d3de7b9c-a04c-4f3d-857c-5365529b71b1 service neutron] (92565) timed out ('10.222.0.30', 60210) {{(pid=92565) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
Jun 01 10:21:45.853103 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:21:56.635659 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:22:10.474306 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-042ebdd7-043f-40c5-8afa-81cf8e0a54b9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:22:12.978124 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-66f6627e-d6cd-4d0b-9caf-fc610ff6d3eb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:22:13.309833 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:22:14.074668 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:22:15.834711 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:22:18.457818 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:22:26.616386 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:22:40.477598 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-4c69bb28-44ba-45ba-b90c-a1a620d241a3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:22:42.951315 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-af786261-01ae-480d-b08d-add480b53c97 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:22:43.277377 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:22:44.082789 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:22:45.858651 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:22:55.458849 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:22:56.629349 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:23:10.468309 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-3bda3ca1-d2ec-4b58-93fe-73a77015081c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:23:12.993000 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-553d27ee-27b8-472e-a3d4-2d9ad8cde538 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:23:13.312757 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:23:14.084380 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:23:15.826749 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:23:26.613788 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:23:32.458718 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:23:40.508815 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-acc5e077-4716-4686-817a-7a035bd27a26 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:23:42.972315 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-ea4280d7-7668-4404-8346-5237abc914a8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:23:43.292132 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:23:44.092562 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:23:45.880066 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:23:56.643982 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:24:09.457621 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:24:10.483232 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-67e7a189-f787-4376-8f03-df5f750f95d0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:24:12.945767 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b9d8e801-57b0-41e7-8df3-c5cfa0f155a6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:24:13.248215 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:24:14.088591 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:24:15.847264 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:24:26.618454 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:24:40.485139 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-16bead3e-d487-4ba8-a3d3-4db43eaedc53 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:24:43.016853 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-33ad6378-10b5-4360-93ab-7e378c8d2902 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:24:43.228165 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:24:44.119495 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:24:45.833315 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:24:46.456449 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:24:56.660184 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:25:10.499343 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-fae429ef-cab3-46dc-b01d-b5511ca44c56 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:25:12.961820 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-ad7a3cb7-8811-4e81-9bd1-c1172db9588a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:25:13.241910 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:25:14.115199 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:25:15.846987 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:25:23.454817 dv-cinder-787262-4-iscsi neutron-server[92568]: DEBUG neutron.db.agents_db [None req-d6b6677f-e4b6-479b-9848-fd4717878ce3 None None] Agent healthcheck: found 6 active agents {{(pid=92568) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 10:25:26.703244 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:25:40.530170 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-e745cccf-9858-4a66-b96d-ab7e91cea8d3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:25:42.964605 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-a2ddbb54-9398-4670-a576-630c27139220 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:25:43.267190 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-8ea2327f-7742-4037-b928-2b1cecb71286 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:25:44.147330 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-144e8ece-35cb-4a1a-a9ba-a9cf77e93a15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:25:45.850381 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-b26a201a-7fac-4da5-b7ca-b88a9359d0bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 10:25:56.700209 dv-cinder-787262-4-iscsi neutron-server[92567]: DEBUG neutron_lib.callbacks.manager [None req-7eadf0ec-8bc8-44d5-b466-1cf061801462 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726958294510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7796890'] for agent, after_update {{(pid=92567) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}